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ABSTRACT 

The central purpose of this book, is to review the 
present state cf the a*.t in adult basic education teacher training. 
Each of the chapters of the book was developed specifically for the 
Workshop to Increase and to Improve University Teacher Training 
Programs in Adult Basic Education, which was held at The University 
of Chicago ^n March 1969. The 24 chapters, which serve as a benchmark 
ot research immediately relevant to adult basic education, have been 
arranged in eight major categories: teacher training, adult students, 
testing adults, curriculum development and materials, economic 
considerations, programs, culture or social stratification, and 
overviews of adult basic education: research and programs. The final 

chapter contains the reactions of the participants in the Workshop, 
and appraises the central problem areas and research concerns for 
improving future teacher ^raining programs. ( D 3 > 
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Introduction 



ABOUT THE CONTRIBUTING AUTHORS 



This publication reflects the research and 
thoughts of leaders in the adult education and 
allied fields. Speaking from various positions in 
public service, education, and research, these 
authors bring a variety of perspectives to the 
examination of the state of the art in adult basic 
education. 

Ray J. Ast, President of the Adult Education 
Association of the United States, is the Admin- 
istrator, Adult Continuing Education Resource 
Center of Montclair State College and Project 
Director, New Jersey ABE Learning Centers. 

Jack Botwinick, Professor of Psychology, 
Washington University, has written extensively 
in the field of Human Development. As one of 
the foremost researchers of the special prob- 
lems in maturity and old age, his basic research 
endeavors provide a dound empirical basis for 
understanding of the adult learner. 

Zahava D. Blum, formerly associated with 
the National Opinion Research Center, is now 
Project Co-Director, Center for the Study of 
Social Organization of Schools, Johns Hopkins 
University. Her work in the sociology of educa- 
tion has given her a broad conceptualization of 
the problems of educating adult illiterates. 

William F. Brazziel, Professor of Higher 
Education at the University of Gonnectic it was 
a principal investigator of the classical Norfolk 
study of vocational training for the culturally 
dit advantaged. This investigation was one of 
the first attempts to examine the influence of 
academic training on job retention of welfare 
recipients enrolled in vocational training. 

Don A. Brown, Director of the Reading De- 
partment, University of North Colorado, has 
administered studies in reading research for 
under-educated adults and is directing the 1970 
International Reading Association's ABE work- 
shop. He is Chairman of The Basic Education 
and Reading committee of that organization. 

Jose A Cardenas, Superintendent, Engle- 
wood Independent School District in San Antonio, 
has been the Director of the Southwest Educa- 
tional Development Laboratory and his work 
among Mexican American migrant workers has 
produced a number of publications. He is a 
consultant on the special problems of Mexican 
Americans for regional and National boards. 

Richard W. Ccrtright has held faculty ap- 
pointments at four universities in the field of 
linguistics, reading and adult education. He is 
currently Assistant Director of Adult Education 
Service of the National Education Association 
nnH nhector of its Adult Education Clearing* 




Arthur P. Crabtree, past president of the 
Adult Education Association and former chair- 
mar’ of the President's National Advisory Com- 
mittee on Adult Basic Education, is currently 
a consultant in aduit education with the New 
Jersey and Pennsylvania State Departments of 
Education. 

Phyllis M. Cunningham, a doctoral student 
in adult education at the University of Chicago, 
is engaged in the study of the relationship of 
eelf-image to retention and achievement in adult 
basic education classes in Chicago. 

Robert C. Druege, Psychologist with the 
Department of Labor and the Department of the 
Army, is currently working with the Manpower 
Administration. He has contributed to the lit- 
erature of educational psychology in the area 
of testing adult illiterates. He is one of the de- 
velopers of the General Aptitude Test Battery 
for testing undereducated adults. 

Eric F. Gardner, Professor of Psychology 
at Syracuse University has co-authored a basic 
text in Educational Psychology and a number of 
standardized diagnostic tests. His work in the 
development of the Adult Basic Learning Ex- 
amination (A.B.L.E.) has advanced our under- 
standing of diagnostic and achievement testing 
of undereducated adults. 

Francis Gregory, Consultant in Manpower 
ani Adult Education, Warner and Warner Inter- 
national Associates, has extensive experience 
in the problems of the undereducated and under- 
employed adult. He formerly was the Special 
Assistant, Associate Manpower Administrator, 
Manpower Administration, U.S. Department of 
Labor. 

William S. Griffith, Associate Professor of 
Education and Chairman of the Adult Education 
Special Field Committee of the University of 
Chicago, developed and directed the “Worksnop 
to Increase and to Improve University Teacher 
Training in Adult Basic Education". He has 
been involved in regional and National projects 
related to ABE and is Chairman of the Com- 
mission of the Professors of Adult Education 
and past president of the Illinois Adult Educa- 
tion Association. 

William Haddad, President of the United 
States Research and Development Corporation, 
has had a varied career working as a journal- 
ist, author, and in various positions of public 
service. He has been Aseociate Director of the 
Peace Corps and an Inspector General in the 
Office of Economic Opportunity. 

Ann P. Hayes is currently Evaluation Spe- 
cialist of the Appalachian Adult Basic Education 
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Demonstration Center, Moorhead State Univer- 
sity. She has served as consultant to curriculum 
and reading workshops in ABE and is presently 
Chairman of the ABE Research Commission in 
the Adult Education Association. 

Tr win P. Jahns, Associate Professor of 
Adult Education at Florida State University, 
has S3rved as program and evaluation consult- 
ant to Coahoma Opportunities, Inc., a major 
ABE project iti Mississippi. 

Raymond L. Johnson, Research Investigator 
at the Institute of Communication Research in 
Silver Springs, Maryland and Chairman of the 
Board of Educational Marketing Plans, Inc. 
has co-authored a diagnostic test for auditory 
and visual word recognition for beginning adult 
readers. 

Bjorn Karlsen, Associate Professor of Edu- 
cation, Sonoma State College, is the principal 
author of the ABLE test. He played a significant 
role at the first national ABE Teacher Trainer 
Workshop sponsored by The Ford Foundation 
at the University of Maryland, 1965, and is con- 
tinuing to work in the area of test development. 

Robert S. Laubach, Executive Director of 
Laubach Literacy Inc., is lecturer for the de- 
gree programs in literacy journalism offered 
at Syracuse University and has written widely 
on Literary efforts in the international arena. 

Herbert Lehmann, Assistant Superintend- 
ent, Education Extension, Chicago Public Schools, 
has had twenty years of experience administer- 
ing adult education programs in a major urban 
school system. 

Joseph Mangano is presently Chief, Bureau 
of Continuing Education, State Education De- 
partment of New York. He has served on the 
Adult Basic Education Committee o f the National 
Association for Public School Adult Education, 
the Adult Literacy Committee of the Interna- 
tional Reading Association, and the Adult Li- 
teracy Committee of the National Council of 
Teachers of English, and has edited the Pro- 
ceedings of a joint institute on adult basic 
education of the three organizations. 

Howard M. McFann, Director of Research, 
Human Resources Research Office, Division #3, 
is a prolific investigator and author in the prob- 
lems of diagnosing and studying educational 
programs in basic and vocational education. His 
rigorous empirical work for Project 100,000 



with the U.S. Army has led to basic designs 
and curricula in working with the educationally 
disadvantaged adult. 

Rolf Monge, Assistant Professor, Syra- 
cuse University, in currently involved in a fi/e 
year research project studying adult learning 
as it relates to aging. 

Monroe Neff, President of NAPSAE, is 
the Director of Continuing Education, New York 
State Education Department. He has written 
curricular materials in adult education and 
has consulted on adult education projects and 
institutes at the national level. 

Herbert L. Nichols, Assistant to the Dean, 
Federal City College, is a media specialist 
who, while at Georgetown University, contrib- 
uted to the developing cf the Video Tape Re- 
corder as a teaching device. 

Wayne Otto, Professor of Curriculum and 
Instruction, University of Wisconsin, served ~s 
the principal investigator, Wisconsin Research 
and Development Center for Cognitive Learn- 
ing. Author of four books on reading and teach- 
ing adults, his contribution to strategies for 
increasing cognitive gain in reading are na- 
tionally recognized. 

William H. Robinson views the problems of 
the undereducated adult from the public sector, 
where he has served as a member of tl ^ Illi- 
nois House of Representatives and subseqr.. Jly 
as Director of Ihe Cook County Departmeir of 
Public Aid. He is currently the Director, De- 
partment of Registration and Education for ti ' 
State of Illinois. 

Kevin Ryan, Associate Professor of Edu 
cation, University of Chicago, is presently an 
Alfred North Whitehead Fellow, Harvrrd Univer- 
sity. Author of books on teaching and teacher- 
training, he is well known for his work on 
micro-teaching at Stanford University. 

Henry Scharles is Associate Professor, 
Department of Management, School of Business 
Administration, Georgetown University. His 
research interest lies in the area of the* eco- 
nomics of adult basic education programs. 

R. Calvert Steuart, Consultant and Director 
of Business Development, Davis McConnell 
FaJston, a Division of Westinghouse Learning 
Corporation, has conducted research in the 
materials and methods of adult basic education. 
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INTRODUCTION 



William S. Griffith 



Adult basic education (ABE) has been the 
subject of national interest since 1964; interest 
which focused initially on the efforts to train 
adult illiterates un^er title 11 -B of the Economic 
Opportunity Act ol .964 (P.L. 88*452). This pro- 
gram, which became operational in 1965, was 
funded by the Office of Economic Opportunity 
and administered by the Adult Education Branch 
of the United States Office of Education. Title 3 
of the 1966 amendments to the Elementary and 
Secondary Education Act (P.L. 89-750), known 
as the Adult Education Act of 1966 shifted the 
funding and administration the program to 
the Office of Education. Since that time the Con- 
gress of the United States has continued and in- 
creased its annual appropriations for this pur- 
pose. There are indications that appropriations 
will continue to rise ir the future. A.-' the annual 
appropriations rise it is oecoming increasingly 
clear that the Congress is now exerting a major 
influence on the development of adult education 
through its special involvement in adult basic 
education just as pievious Congresses made 
lasting impacts on adult vocational education 
through the passage of the Smith-Hughes Act in 
1917 and on adult education in rural areas 
through the enactment of the Smith-Lever law 
in J.914. Accordingly, a careful examined n of 
the nature of adult b^sic education is oi vital 
concern not only to those who are interested 
in improving such programs but to adult educa- 
tors in general. 

In providing funds for adult basic education 
in 1964 the Congress expressed the intention 
of assisting adults whose lack of skills in read- 
ing and writing were restricting their possibili- 
ties of securing employment commensurate 
with their potential ability. 1 The legislation 
focused on assisting adults to reduce their de- 
pendence on ethers and to enable them to meet 
their adult responsibilities rr.cve adequately.' 
Subsequent legislation has not altered the pur- 
poses of the pregram appreciably. 

At the time the Economic Opportunity Act 
was passed there were relatively few persons 
professionally prepared to plan and to adminis- 
ter literacy programs. Despite the fact that the 
first recorded training session for teachers of 
adult illiterates took place in 1911 in Kentucky, 2 
the meager amounts of federal, state or local 
funds which were provided to support literacy 
programs were insufficient to encourage end 
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facilitate the development of a core of career 
professional adult educators devoted to working 
in baric education. Accordingly when the fed- 
eral government made hundreds of millions of 
dollars available luring the depression years 
to train hundreds of thousands of adult illiter- 
ates to read and write 3 ’ 4 it was necessary to 
employ as instructors individuals who had had 
no special preparation for wo*k. During World 
War II the federal concern shifted from literacy 
education to vocational education and so even 
though the depression programs provided hun- 
dreds of thousands of Americans with their first 
exposure to adult literacy education, the cessa- 
tion of federal funding for ouch programs ef- 
fectively obliterated the positions which could 
have become lifetime careers for Literacy teach- 
ers. And so it was that when funds were made 
available to develop adult basic education pro- 
grams in 1965, one of the first problems to be 
faced was the lack of persons professionally 
qualified, at least in the sense of having had 
specific academic training, to teach illiterate 
pdulttr. 

Tilt* central purpose of this book i3 to re- 
view the present state of the art in adult basic 
education teacher training as a way of present 
ing in one document the central research base 
which undergirds the adult basic education 
teacher training programs in institutions of 
higher education. Each of the chapters m this 
book was developed specifically for the Work- 
shop to Increase and to Improve University 
Teacher Training Programs in Adult Basic 
Education held at The University of Chicago in 
March, 1969. 

But before turning to an overview of this 
book it seems necessary to consider the pres- 
ent level of adult illiteracy and to proje:t esti- 
mate? for the next three decades. Seme may 
believe that there are few illiterate adults in 
the Uniied States today and that there will only 
be an insignificant number in the future. It is to 
those who have such a view of the situation that 
the next several paragraphs are addressed. 

THE INCIDENCE OF ILLITERACY 

The data on illiteracy and trends for the 
future show little promise that the illiteracy 
problem wiil be solved either internationally 
or nationally in this century. Internationally, 



although the world’s rate of illiteracy declined 
from 44.3 per cent to 39.3 per cent between 
1950 and I960, as a result of the tremendous 
population growth which occurred during the 
decade the absolute number of illiterates in- 
creased from the level of 700 million to 740 
million. 5 Further, the drop-out rate in pri- 
mary schools averaged 21 P'r cent annually. 6 

Nationally the magnitude and the trends of 
the illiteracy problem have been estimated for 
the U.3. Office of Education under a special 
contract calling for the designing of a plan for 
solving the illiteracy problem. 7 In this p.an 
the term Educationally Disadvantaged Popula- 
tion (EDP) was applied to those persons 18 years 
of age or older who had not completed eight 
years of formal schooling. According to the 
I960 census about 24 million persons, or 13.4 
per cent of the total population fit this category. 
The EDP constituted 20.9 pel cent uf the total 
adult population aged 18 or over. 

It is likely that the census figures under- 
state the magnitude of the problem for two rea- 
sons. Fir^t, even though a person may have 
progressed through the eighth grade he may not 
have been making use of his education and there- 
fore regressed through a period of years to a 
lower achievement level. Second, even though a 
person may have attended school for eight years 
it is not safe to assume that an eighth grade 
level of proficiency was attained. A study of 
able-bodied welfare recipients conducted by 
the Cook County Department of Public Aid in 
Chicago reported that on the basis of self- 
reports of grades completed about 6.6 per cent 
of the sample would be classified as function- 
ally illiterate. However, on the basis of scores 
obtained through the administration of the Stan- 
ford Reading Test for grades 2-9, there were 
50.7 per cent of the 689 member sample who 
were performing at less than a sixth grade 
level. 8 

Projections of the size of the EDP were 
calculated into the first decade of the 21st Cen- 
tury based upon the following assumptions: (1) 
there is and will continue to be a sizeable drop- 
out rate in the elementary and secondary edu- 
cation system; (2) the environment of the people 
in the EDP will not change appreciable with 
regard to motivation, encouragement, facilities 
and opportunities for continuing education; {3) 
there will be no literacy program of sufficient 
magnitude to have any appreciable effect on the 
estimates; (4) the percentage of the P^DP in each 
succeeding age cohort of 18 years old is and 
will continue to be about 6.3 per cent; and <o) the 
mortality rate of the EDP does not and will not 



differ significantly from the mortality rate of 
the total population for comparable age groups. 9 
Based on these assumptions it was calculated 
that the total EDP would drop from 23.9 million 
persons in 1960 to 19.6 millions in 1973, 16.7 
millions in 1983, and 14.9 millions in 1998, the 
lowest number of educationally disadvantaged 
persons in the United States in this Century. 
And then, because of the accumulation of illit- 
erates produced by an appreciably larger popu- 
lation, the a .solute number of educationally 
disadvantaged persona is predicted to begin 
**sing. 

Even though not all of the assumptions ap- 
pear equally valid, the basic trend and the ap- 
proxim ite magnitude of the estimates do not 
seem unreasonable. It may seem logical to 
suppose that the EDP has a high r mortality 
rate than does the literate seetc. he popu- 
lation because of differences in nutrition and 
health care for the two groups and therefore 
the EDP does not have the same life expeciancy 
as do those who are literate. On the other hand, 
it is clear that there are many new school drop- 
outs each year and the percentage of dropouts 
appears to have stabilized. 

The major factor which accounts for the 
predicted decline in the EDP until about 1998 is 
the death rate of the population which was over 
45 years of age and 70 percent illiterate in 
I960. 10 

On the basis of these estimates it seems 
incontrovertible that the need for conducting 
literacy piograms will persist welt into the 
21st Century. Accordingly, the development of 
improved methods of teaching illiterates and 
of training the teachers of illiterates seems 
sound and in fact essential if the number of 
adult illiterates is to be lowered significantly 
in this century by other than natural causes. 
Further, even if it should be possible to nearly 
eradicate illiteracy in the United States, the 
rapidly increasing numbers of illiterates 
throughout the world would present a challtnge 
which this nation could not afford to overlook. 

Because of the evident need for enlarging 
and for increasing the effectiveness of literacy 
programs in the United States in the decades 
ahead a national conference was held to exam- 
ine the state of the research base for teacher 
training programs in adult baste education. 
The chapters of this volume are the invited 
papers which were commissioned for and dis- 
cussed at the Workshop. 

THE PROBLEM OF DEKJN1 MON 

Despite all of the money and time which 



have been spent on literacy programs it may 
be somewhat discouraging to have to admit that 
there is no universally acceptable definition of 
key concepts in the field such as illiterate, 
functionally illiterate, and basic education. 
Some authors believe that in the United States 
today a basic education is equivalent to 12 years 
of schooling. Federal legislation has included 
the eighth grade level in basic education al- 
though a number of senators and congressmen 
would like to have tlus deflation changed to in- 
clude high school completion. Definitions of 
functional literacy vary also as would seem 
reasonable as higher levels of education are 
required to enable an individual to function ef- 
fectively. Accordingly care should be taken in 
the interpretation of literature dealing with 
adult basic education lest incorrect definitions 
be assigned to terms which may be used idio- 
syncratically by various authors. 

UNIVARIATE SOLUTIONS FOR 
MULTIVARIATE PROBLEMS 

One criticism stands out above all others 
regarding the literature on adult basic educa- 
tion: univariate solutions are being sought for 
multi-variate problems. Fruitless efforts seem 
to be attempted afresh each year seeking to 
answer such questions as: What is the best 
method of training adult basic education teach- 
ers? What is the best curriculum for teaching 
illiterate adults? What kind of person makes 
the best teacher for adult illiterates? What is 
the best way of teaching illiterate adults? What 
is the best way to Lest adults? and many others. 
These questions have in common an erroneous 
assumption, and that assumption is that the 
concepts being derlt with are simple rather than 
complex. 

Two approaches exist for conducting rigor- 
ous research in adult education. The first, and 
this is beet exemplified in the chapters by Bot- 
winick, N^onge ard Gardner, and McFann is the 
restriction of the problem to be dealt with to 
modest proportions so that by careful control 
the investigator is able to speak with assurance 
regarding the relationships among a restricted 
number of discrete variables. In the second 
approach great care is taken to define complex 
variables by identifying their parts. Jahns and 
Bluu ' advocate this approach and various other 
chapter authors acknowledge its validity even 
though in retrospect they may have to admit 
that their treatment of key variables has been 
overly simplified. 

Perhaps the greatest advanc?s in cur knowl- 
edge of adult basic education will come about 



only after those who do research in the field 
stop seeking the best answer to problems and 
instead approach their investigations with a 
basic orientation which asks: What kind of 
teachers (race, sex, I.Q., personality, motiva- 
tion) are most effective (as measured by what 
instrument) in teaching what kinds of students 
(age, sex, I.G , motivation) what kind of content 
(job-related, hobby, family, health, recreation) 
at what level of cognitive complexity using what 
methods, and what teaching style in what set- 
ting? It seems apparent that only as detailed 
descriptions are provided for each of the inter- 
acting variables will the research findings be- 
gin to be cumulative. In a sense this volume 
with its chapters of varying quality is a detailed 
statement of particulars documenting the need 
for strengthening and expanding the research 
base if adult basic education teacher training is 
to progress beyond its present primitive state. 

THE ORGANIZATION 
OF THE CHAPTERS 

The twenty four chapters which have bee: i 
brought together to se t ve as a benchmark of 
research immediately relevant to adult basic 
education have been arranged in eight major 
categories; Teacher training, adult students, 
testing adults, curriculum development and 
materials, economic considerations, programs, 
culture or social stratification, and overviews 
of adult basic education: research and pro- 
grams. The concluding chapter presents the 
reactions of the Workshop participants to each 
paper and then appraises the central problem 
areas and research concerns for the improve- 
ment of teacher training programs for adult 
basic education teachers in the future. 

TEACHER TRAINING 

The first 5 chapters deal with teache; train- 
ing programs in adult basic education. Neff 
identifies and documents the existence of three 
discrete and largely uncoordinated university 
groups engaged in training professional work- 
ers in adult basic education. The tabular pres- 
entation of the universities engaged ip. long and 
short term training programs shows that the 
contracts which th • Office of Education has 
awarded to support teacher training workshcos 
hae nc.' been directed toward the strengthening 
of an existing capacity, but rather to the en- 
largement of the number of institutions involved 
in such activity. Perhaps the most perplexing 
aspect of Neffs presentation is the documenta- 
tion of the apparent inadequacy of the inforrnr- 



lion state directors of adult education have of 
training opportunities within their own states 
for persons engaged in administering or teach- 
ing in adult basic education. 

Johnson, Cortright and Laubach report on 
their effort to develop a relatively simple and 
economical system of data collection and analy- 
sis suitable for the routine, moderately budg- 
eted, short-term teacher training program. 
They observe that although it was possible to 
detect shifts of teacher opinion regarding adult 
illiterates, methods of teaching and motivating 
adult basic education students after a 9-hour 
training program, the behavior of the teachers 
back on the job quickly regressed to the pre- 
vailing norms of the program. 

Ast cautiously describes the potential value 
of the learning center approach while warning 
against the development of over enthusiasm for 
the latest approach to adult basic education. 
Basing his discussion on a logical analysis of 
the characteristics of adult learning centers as 
educational svstems, he argues for the explicit 
designation of responsibilities for all members 
of the center staff. Acknowledging the paucity 
of research findings on learning center effec- 
tiveness. he advocates the use of self-evalua- 
tions by each staff member who subsequently 
must discuss bis self-assessment with the cen- 
ter director. 

Ryan argues persuasively for the need to 
identify the professional skills and strategies a 
teacher should have before attempting to design 
programs to develop specific skills. Through 
the use of the video tape recorder he provides 
teachers in training with five kinds of feedback 
un the adequacy of their performance wRh r>- 
gard to specific skills. Although R>an asserts 
that the scientific study of teaching is new, the 
reader will discover that Ryan bases his train- 
ing program on an unsupported assumption that 
the specitic teaching skills which he seeks to 
develop produce significant differences in the 
learning of students. 

Nichols describes a four-phase autoinstruc- 
tk nal program which has not yet progressed 
beyond the first phase for preparing teachors 
of English as a second language. After the com- 
pletion of the first phase, which is the opera- 
tional description of the behavior of the master 
skilled teacher through the use of video tape, 
he expects to be able to make a theoretical 
analysis of the data, to prepare materials for 
the instruction of teachers in those behaviors, 
and then to test for tho effectiveness of ihe 
system in enhancing ABE student learning. 



ADULT STUDENTS 

To a greater extenc than most of the other 
chapters, the three chapters in this section ex- 
emplify excellence in reporting and rigor in 
an^ysis. 

Monge and Gardner describe their efforts 
to contribute to increasing the effectiveness of 
retraining and adult vocational rehabilitation by 
increasing the knowledge base regarding adults* 
intellectual resources and learning ability. This 
progress report on the Syracuse University 
Adult Development Study presents the three 
hypotheses which are being tested: (1) a meas- 
urable portion of the decrement in learning 
performance usually found with increasing age 
may be attributed to greater susceptibility of 
older adults to psychological stress; (2) the 
degree to which an adult can learn controver- 
sial material is influenced by his attitudes to a 
greater degree than is tree ;or the younger 
adult; and (3) older adults do not know how to 
learn as well as younger people. The results 
of the testing of these hypotheses will be *f 
considerable interest to adult educators con- 
cerned with providing basic education to older 
adults. 

Botwinick examines the accelerating rate 
of increase in the production of research deal- 
ing with adult development and predicts an in- 
creasingly chaotic situation unless textbook 
writers apply themselves to summarizing and 
integrating the flood of literature. One might 
hope that Schaie’s approach to methodology in 
developmental research described in this chap- 
ter will be applied to the testing of Monge and 
Gardner’s third hypothesis. Botwinick presents 
a summary of the research on the effects cf 
aging on adult intelligence, speed of response, 
perception, and personality, fie also empha- 
sizes the irnoortance of the concept ual differ- 
ence between the process of learning and the 
performance which serves as an indicator that 
the process has occurred. 

McFann, in discussing the adaptation of 
training strategies to match individual differ- 
ences, draws upon his experience with the train- 
ing of low ability (Wechsler adult intelligence 
scale scores of 70-91) men in army training 
centers. He reiterates the warning which has 
been made by many others concerned with 
measuring student progress, that rigorous as- 
sessment is impossible unless the terminal 
learning objectives are clearly stated in be- 
havioral terms. 



TESTING ADULTS 

One of the major difficulties involved in the 
operation of adult basic education programs is 
that the measuring Instruments for assessing 
student progress are generally less than ideal. 
The authors of the two chapters in this section 
appear to be optimistic about the likelihood of 
significant progress in this area over the next 
few years. 

Droege presents a detailed description of 
the difficulties encountered when one attempts 
to administer tests to disadvantaged adults. He 
then offers a set of strategies for overcoming 
these difficulties. In this chapter eight criteria 
are suggested for an achievement test which 
fully meets the requirements for use with hard 
core unemployed and disadvantaged adults. Then 
Droege describes the development of the Basic 
Occupational Literacy Test (BOLT; which he 
believes will satisy all eight criteria. Of par- 
ticular interest to those who are more inter- 
ested in preparing adult illiterates fui em- 
ployment than for qualification for 8th grade 
certificates or high school diplomas is the work 
sample assessment technique, a technique 
which appears to hold great promise for those 
who are disturbed by the credentials barrier 
to employment. 

Ko risen review? the research on the test- 
taking behavior 01 adults and concludes that the 
testing experience i3 qualitatively different for 
adults from that of children. In this chapter the 
author justifies the use of giade norms for adult 
tests, a concept that is unpalatable to tho'.e who 
may b 1 overly sensitive to the risk of slighting 
the egos of illiterate adults. Karlsen explains 
the procedures which he followed in developing 
the adult .basic learning examination (ABLE) 
test and the procedures used in the development 
of norms. 

CURRICULUM DEVELOPMENT 
AND MATERIALS 

Three papers presented at the workshop 
dealt with curriculum development and mate- 
rials. Bruwn studied the reading interests of 
adult basic education students as an essential 
step in the development of curricular materials 
that would be more like T y to maintain the levil 
of interest and attention of adult students than 
typical commercial materials. Although he ac- 
knowledges that the mastery of even the most 
mundane of materials has managed to hold 
many learners for a long time, he believes that 
adults will learn be**rr if they are reading about 

:s of concern to them. No data are presented 




to establish that the effectiveness of adult learn- 
ing is significantly improved by the use of ma- 
terial which is inherently of greater interest 
to adult students but Brown does demonstrate 
that the reading of literate and illiterate adults 
are more nearly alike than either group's in- 
terest is like that of suburban or inner-city 
children. 

Otto reviews what has r* ien established by 
research on reading and what must be investi- 
gated if the effectiveness of adult literacy pro- 
grams is to be increased. He comments can- 
didly that despite the inadequacy of the research 
base, practitioners have been amazingly suc- 
cessful in teaching adults to read. Otto empha- 
sizes the point that reading skill sequences have 
been developed for elementary school children 
and that reseaich with adult illiterates should 
build upon the base which consists of skills 
dealing with v/ord jecogniti jn, comp, .hension, 
study skills, self-directed reading, interpretive 
reading, and creative reading. The development 
of an adequate evaluation program for teaching 
reading to adults can best be constructed from 
? skill sequence outline such as that provided 
in tin* chapter according to Otto. 

Steuart studied 70 students in two classes 
for 48 arid 54 hours of instruction in an effort to 
determine the relative effectiveness of analytic 
and synthetic approaches to reading instruction. 
His conclusions echo those of other investiga- 
tors who have attempted gross comparisons of 
methods and obtained nonsignificant results. 
Although no measures of student motivation 
were attempted, Steuart comments that his ob 
serrations lead him to believe that this variable 
is potentially a powerful predictor of student 
performance. 

ECONOMIC CONSIDERATIONS 

It seems clear that the Congress had a con- 
cern for economic benefits to the nation which 
were assumed to be the inevitable product of 
ABE programs. In the following two chapters 
the economics of illiteracy and the effective 
ness f economic rewards as a motivator of 
adult learning are treated. 

Scharles presents an elementary overview 
of illiteracy economics in which he clearly dis- 
tinguishes between the consumption and invest- 
ment aspects of education. It is unfortunate that 
at this point in time whe n f d few hard facts are 
in the literature regarding the financing of adult 
education the data base uf this chapter was 
rather restricted. 

Gregory methodically and meticulously re- 
view’s the literature on the us^ of preparation for 
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employment a3 a motivator for participation in 
ABE and concludes that despite the accumulated 
amorphous mass of evidence, the conclusion 
that this variable is the key explanatory vari- 
able is still intuitive. He notes that something 
more than the charm of the schoolhouse and 
purity of knowledge is needed to activate ^ e 
undereducated adult to enter and stay with a 
program of basic education. From the stand- 
point of a person well acquainted with the litera- 
ture on education and employment, Gregory 
lists seven high priority research needs for 
ABE and manpower training programs which 
are deserving of careful attention. 

PROGRAMS 

Five chapters are grouped under the head- 
ing of programs because they emphasize the 
particular practical aspects of action programs. 

Brazziel reviews the definition of counsel- 
ing ai.d the history of the counseling problem 
in ABE. He identifies specific procedures which 
have been used and discusses their implications. 
Of particulai significance to universities now 
.aged in or preparing to begin training pro- 
grams in adult education is Brazziel’s asser- 
tion that the supply of training opportunities 
for counselors is entiiely inadequate for ABE 
needs. 

Cardenas addresses himself to the problems 
of planning and evaluating ABE programs for 
Mexican -America ns. His presentation is firmly 
grounded in practical experience, but his con- 
clusions lack the quantitative underpinning 
which will be required to convince a rational 
skeptic. Cardenas advocates the use ot the 
CIPP (context, input, process, and product) 
evaluation system for ABE programs even 
though no data are presented to chow how this 
system has been used to date. Accordingly, the 
expiessed commitment to the system is based 
more on expectations than upon demonstrated 
effectiveness. 

Mangano rep." rts cn the evaluation of a Head 
Start parents 1 adult basic education program 
conducted with Spanish speaking parents in New 
York City. He criticizes curriculum developers 
in adult b^sic education for using an oversim- 
plified conceptualization cf ABE which leads 
away from rather than toward specific cur- 
ricular activities designed for specific popula- 
tions. The data collection procedure used to 
assess the effectiveness of the project uti- 
lized questionnaires in both English and Spanish 
to measure personal and social adjustment 
changes. Practical suggestions for program 
■mproverrr 't based upon observations and 



common sense are presented. 

Robinson presents a case study of adult 
basic education needs in Cook County, Illinois, 
in which he makes a strong case for inadequate 
education as a major factor predisposing in- 
dividuals to a poverty existence. He concludes 
that although undereducation is not the sole 
cause of poverty and that education alo^e can- 
not be the sole cure for poverty, educational 
programs have had demonstrably favorable ef- 
fects for welfare recipients. He suggests that 
administrators planning ABE programs take 
nine factors into consideration if they ,vish to 
increase theii chances for success. 

Lehmann relates the experience of the pub- 
lic schools of Chicago in attempting to meet 
thr educational needs of Cook County Depart- 
ment of Public Aid welfare clients and does 
not gloss over the considerable difficulties en- 
countered when one attempts to coordinate two 
huge bureaucracies. He identifies four major 
problem areas in the program and describes 
the use of a joint advisory committee in im- 
proving coordination. In complete candor he 
acknowledges that the ABE program continues 
to suffer from a high dropout rate and inadequ- 
ate in-service educational programs for the 
staff. 

CULTURE OR SOCIAL 
STRATIFICATION 

As long as the poverty programs have been 
in operation a debate has raged over the ques- 
tion: is there a culture of poverty? The authors 
of the two papers in this section were invited to 
contribute papers to the Workshop because they 
were known to have taken opposing pocitic % s on 
the question. 

Haddad insists that subcultures of poverty 
exist and that they can be defined quantitatively 
and qualitatively although he does not succeed 
in doing so. While admitting that there is pres- 
ently no commonly accepted operational defini- 
tion of poverty or of a culture of poverty, he 
asserts that there is a recognizable disenchan- 
ted minority who do not see the prevailing cul- 
ture as relevan 1 to themselves and therefore 
belong to a culture of their own. 

Blum criticizes studies of the poor or rather 
the authors of Judies of the poor because they 
seem either to be inclined to want to seek out 
distinct traits as a way of defining the poor or 
they appear to be motivated by a desire to do 
something helpful for the poor. She advocates 
the use of the concept of social stratification 
which sees the poor as differing in degree bui 
not in kind from persons of higher socio eco- 



mic status. Thio concept assumes that the life 
style of the poor will not interfere with their 
adaptation to economic opportunity. Blum pre- 
sents a thorough review of the literature dealing 
with images of the poor and concludes that while 
the poor differ quantitatively from the other 
socio-economic strata, they do not differ basi- 
cally in a qualitative sense. She concludes her 
chapter with suggestions for research of a 
multivariate nature, much of it aimed at illu- 
minating the relationship between socioecono- 
mic status and indicators of success in the 
tormal academic system. 

OVERVIEWS OF 
ADULT BASIC EDUCATION: 
RESEARCH AND PROGRAMS 

Thn final pair of papers presented at the 
Workshop are at a somewhat higher level of 
generality than the earlier papers. Jahns pre- 
sents an overview of adult basic education re- 
search which focuses primarily on doctoral 
dissertation investigations conducted at Florida 
State University. He discusses descriptive stu- 
dies, outcome studies, and process studies in 
turn and then calls for additional research which 
will simultaneously consider the following vari- 
ables: teacher, student, subject matter, metho- 
dology, classroom environment and social mi- 
lieu. His key criticism of the ABE research to 
date is that it fails to explore the students’ be- 
havior in the world outside the classroom. 

From his vantage point as the first Chair- 
man of the President’s Advisory Committee on 
Adult Basic Education, Crabtree presents his 
overview of the weaknesses and strengths of 
the ABE program nationally. He faults the pro- 



gram for lacking a commonly accepted purpose 
in origin and implementation; for unduly em- 
phasizing occupational objectives and under- 
emphasizing increasing competence as a citi- 
zen, parent, and homemaker; for a lack of ad- 
ministrative coordination at the federal level: 
and for its encroaching shadow of nonprofes- 
sionalism. On the other hand he regards the 
program as having three important positive 
aspects: it has served over or.e million adults; 
it is contributing to the development of the 
adult education field; and it is making a positive 
social contribution for the 34 million Ameri- 
cans who are living in poverty. On the balance 
it is clear that Crabtree favors the continua- 
tion of the ABE program but that he has very 
strong feelings about the need for certain speci- 
fic improvements. 

THEORY AND PRACTICE 

In the final chapter of this volume the res- 
ponses of the Workshop participants to the 24 
papers are presented in summary form. In 
addition, the observations of the Workshop 
director and of gradual. Hudents in adult edu- 
cation who assisted with the administration of 
the Workshop are provided. These remarks are 
essentially reactions to the ideas presented by 
the authors of the chapter but in a number of 
cases in which it appeared that certain con- 
troversial matters were being avoided, the edi- 
tors have exercised the option of exposing these 
thorny issues. Accordingly both theoretical and 
practical issues are raised so that the reader 
may mull them over as he reflects on the state 
of the art in adult basic education teacher train- 
ing. 
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Teacher Training 



THE STATE OF THE ART IN ADULT BASIC 
EDUCATION TEACHER TRAINING 



Monroe Neff 



Adult education has been described by the 
O mission of the Professors of Adult Educa- 
tion as an emerging field of university studj'. 
Each of the maior subdivisions of the field is 
in the process of emerging and so it is that the 
state of the art in adult basic education profes- 
sional training is just beginning to develop a 
definitive form and a common curriculum. Ef- 
forts to train teachers and administrators for 
adult basic education programs have been con 
ducted by at least three discrete groups, each 
functioning largely in isolation from the others. 

The purpose of this paper is to review the 
origin and development of the three groups and 
then to examine the extent tc which the work of 
the groups has been made known to the state 
level adult basic education leaders who have the 
responsibility of encouraging and facilitating 
preservice and inservice education for per- 
sonnel in local programs. 

It would be misleading to imply that no one 
has attempted deal with these groups. Each 
focus hus beer dealt with irfivid tally in some 
way. To date, however, it appears that no one 
has treated the three groups simultaneously, 
seeking evidence of a Deception of common 
goals, and then assessed the extent to which 
state officials working in adult basic education 
have knowledge of the training opoortunities. 

Investigators who have sought to describe 
the development of professional preparation 
programs for adult educators have produced 
disparate results largely because of the differ- 
ent views they have of the field. The three major 
viewpoints may be characterized as follows: 
(1) adult education is a field of graduate study 
and the individuals who go through the educa- 
tional program may be employed to work in 
any aspect of the field incliding basic educa- 
tion; (2) adult basic education is a derivative 
of linguistics or of English and personnel who 
are being prepared to work in adult basic educa- 
tion may get their training most appropriately 
through linguistics or English departments of 
universities; and (3) adult basic education is a 
field of practice for which persons may be pre* 
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pared by engaging in short-term workshops 
which will add skills in teaching adults to those 
who already possess professional skills in ele- 
mentary education. 

ADULT EDUCATION AS A 
GRADUATE FIELD 

Svenson denned adult education leaders as 
professional p' .oO.is who devote their full tf.me 
to adult education activities. 1 He sought to iden- 
tify the kinds and extent of professional train- 
ing opportunities provided by college and uni- 
versity schools of education for individuals 
plan. dng to engage in adult education teaching, 
research, administration, and counseling. 

Svo'son traced the beginning of formal 
teacher u dining efforts to 1923 when the De- 
troit Teachers College offered a couise en- 
titled, "Methods in Teaching Foreign Adults” 
which carried one and one-half semester hou^s 
of credit. 2 Less formal special training efforts 
consisted of in-service type workshops, con- 
ferences and seminars usually held in the sum- 
mer. The staff for these informal training ses- 
sions were usually adult education practitioners 
assisted by selected university faculty mem- 
bers. The curriculum was frequently not planrnd 
ahead of time. Instead, it was developed from 
the experience of the participants. 3 

In the autumn of 1952 Svenson sent ques- 
tionnaires to the 326 presidents of colleges and 
universities which (1) had been accredited by 
their regional accrediting organization, (2) of- 
fered graduate work, and (3) had more than two 
graduate faculty members in education. On the 
basis of an 87 percent return, he reported that 
56 institutions were providing some course 
work in udult education. 4 He divided these in- 
stitutions into four categories based upon the 
extent of their offerings as foVows: Category 
1. Institutions which offer one or two courses 
in adult education; 5 Category 2. Institutions 
which have a limited but often expanding tra'ning 
propram in adult education; 5 Category 3. In- 
stitutions which allow research for the doctors 



thesis to be conducted in adult education; 7 and 
Category 4. Institutions which offer a curricu 
lum leading to the doctorate in adult education. 8 

Svenson reported that between 1941 and 
1952 there were 96 different institution ? of- 
fering course work in adult education at one 
or move or their summer sessions. 9 

On the basis of his examination of the ques- 
honnaries filled out by those who were working 
in the adult education training programs, he 
conuuded: “Most professors of adult education 
know little about adult education training pro- 
grams conducted in other institutions/' 10 

In a report published in 1948 Hallenbeck 
reported that he had examined the graduate 
curricula in adult education. The basis of his 
identification of institutions is not stated in the 
article. He noted four courses which were com- 
monly given although the specific titles were 
not identical: (1) general introduction to the field 
of adult education, (2) community and community 
organization, (3) psychology of adults, and (4) 
materials and methods. 11 The programs he 
examined apparently were not associated with 
linguistics departments and exhibited no special 
emphasis on literacy education. One might 
assume he had not looked at linguistics de- 
partments because of his definition of adult 
education. 

Houle has also examined the evolution of 
graduate training programs for adult educa- 
tors. He prepares an annual listing of persons 
who have received a doctorate in the preceding 
year which is published in Adult Leadership, 
the monthly journal of the Adult Education As- 
sociation of the United £»ates. 

lie notea that the preparation of a compre- 
hensive plan for a complete system for the 
preparation of adult educators involves five 
distinct steps: (1) the operational definition of 
the traits of the successful adult education 
pracv.iioner, (2) the recruitment and selection 
of candidates for training; (3) the training of the 
candidates in ways that will assure that they 
gain competence in the duties they are expected 
to perform; (4> the orientation of the trained 
individual to his first professional position; 
and (5) the continuation of training to maintain 
hi b competence, to provide him with new skills, 
and to equip him to meet new responsibilities. 12 

Houle attributes the emergence of graduate 
programs in adult education t> the development 
of a widespread interest in the provision of 
spedal programs to train teachers of immi- 
grants/ 3 University departments of education 
began offering short-term training progiams 
for teachers of adults following the passage of 







the Smith-Hughes Act in 1917. The prepara- 
tion of teachers of vocational ad lit education 
emerged as a specialty in that those who were 
being prepared to teach or administer evening 
classes in home economics, agriculture, or 
industrial subjects were led to think of them- 
selves primarily as professionals in vocational, 
rather than adult, education. Because of the 
provision of federal funds and the development 
of secure full-time positions in the field, the 
vocationa 1 adult educators formed a national 
&F*edaI interest group. Their common funding 
source evidently served to stimulate, sustain 
and foster cooperation among the professionals. 

Columbia University offered the first course 
with the woeds “adult education" in its title in 
19/2 14 and other universities followed the lead 
A survey of unstated dimensions reported in 
1964 showed that forty -four colleges and uni- 
versities had had one or more courses in adult 
education and that thirty-two others had re- 
cently offered such courses. 15 Houle notea that 
World War II was accompanied by a decline in 
the number of courses offered so that in the 
summer of 1945 only twenty-six courses were 
identified However, the proliferation of courses 
resumed with fifty-two courses in 1946 and 
seventy in 1947. 16 These single courses tended 
to blossom into full blown graduate programs 
so that by 1962 there were fifteen universities 
in the United States which had active programs 
leading to masters and doctors degrees in adult 
education. 17 

In 1968 Ingham and Qazilbash reported on 
a study of graduate adult education programs 
in the United States and Canada. Their data 
were taken from questionnaires which had been 
completed by members of the Commission of 
J he Professors of Adult Education, a formally 
organized grou:> of university teachers and re- 
searchers who are engaged in teaching at the 
graduate level in adult education. For the most 
part the Commission has not exptessed a par- 
ticularly strong interest in literacy education 
during its fourteen year existence. This selec- 
tion procedure depended upon the membership 
policies of the Commission for its principle of 
selection. In examining the course descriptions 
they received from twenty-six institutions they 
found certain courses which appeared to be 
taught at all of the institutions: (1) a survey of 
the field of adult education, (2) program devel- 
opment in adult education, (3) adult learning, 
and (4) general administration. A number of 
other courses were identified which did not fit 
into the four previously listed categories: (1) 
education for community leadership, (2) adult 
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literacy and fundamental education, (3) the 
adult citizen, (4) parent education, (5) seminar 
in group and interpersonal relations, (6) the 
democratic idea and adult education, (7) prob- 
lems of work and leisure, and (8) community 
development.- 

There were fifty-five full-time and eighty- 
two part time faculty membera in the twenty-sLx 
institutions. 19 

Anindividual seeking opportunities to pursue 
graduate study in adult education might not be 
able to i ell that an opportunity existed if he 
regarded the titles of some of the programs 
literally: leadership in community services, 
adult and employee development, extension edu- 
cational administration and supervision. 20 Yet 
all of thsse programs had in common a per- 
ception cf adult education as a broad general 
field of jaaduate study. This common percep- 
tion difftrs markedly from that of those who 
considerei the field as an applied segment of 
linguistic i or reading. 

ADULT EDUCATION AS SPECIALIZED 
LITERACY TRAINING 

Cortnght, the first director of the Literacy 
Center at Baylcr University, has dealt with the 
development of specialized literacy training 
programs. His approach to the problem of defi- 
nition emphasized those institutional programs 
which wece clearly Identified as literacy stu- 
dies. He teported that in 1957 Bailor had de- 
veloped the first undergraduate curriculum in 
!itera:y sludies to train foreign and American 
literacy specialists. 21 The program was de- 
veloped to meet the "great need for trained 
specialist* to direct literacy programs, pre- 
pare basic literacy materials, and write series 
of continuation texts for the progressing new 
readers.” 22 

Av Baylor the literacy curriculum had five 
major emphases: (1) basic literacy studies, (2) 
introduc ' ' 1 - to linguistics, (3) teaching English 
as a foreij; » language, (4) writing for new liter- 
ates, and ;5) senior literacy studies. 23 In 1963 
the first graduate program specializing in li- 
teracy education was instituted at American 
University in its Department of Education. 24 

Syracise University offered the first grad- 
uate degree curriculum in literacy journalism 
in 1952. 25 Uortright identified a total of seven- 
teen educational institutions which provided 
course woih to dev ’ >p competence in literacy 
education. 2 * 

The institutions in this second group all had 
programs which took persons with no previous 



training in elementary education, adult educa 
tion, linguistics, or reading and provided a ful 
undergraduate or graduate degree program de 
signed to produce graduates with highly speci 
fic skills in adult basic education. Both the 
programs to train generalists to work in adult 
education and those tc train specialists to work 
specifically in adult basic education were de 
veloped under the assumption that a long term 
program is required to develop the essentia] 
skills of the adult education professional. Th< 
third approach to training proceeds on a dif 
ferent assumption. 

ADULT EDUCATION TEACHING 
AS AN ADDITIONAL SKILL 

The third kind of training program is based 
on the assumption that individuals who already 
possess skills in elementary education require 
only an intensive short term learning experi- 
ence to enable them to adapt those skills to the 
instruction of adult illiterates. 

Title II-B of the Economic Opportunity Act 
of L9o4 allocated funds for teacher training 
programs at the state level but not for the train- 
ing of teacher-trainers. Because adult basic 
education programs had offered few opportu- 
nities for career employment prior to 1964, 
teacher training institutions had not emphasized 
the development of training programs and con- 
sequently had few faculty members who were 
well qualified to engage in teacher training for 
adult basic education teachers. The Ford Foun- 
dation, in cooperation with the United States 
Office of Education, provided the financial sup- 
port for three two-week workshops in 1965 at 
the Universities of Maryland, New Mexico, and 
Washington. 

The National Association for Public School 
Adult Education was instrumental in planning 
and conducting the three workshops in 1965. 
An invitational planning meeting was called by 
the Association to serve three purposes prior 
to the convening of the three workshops: (1) to 
assess the changing picture of adult basic edu- 
cation; (2) to analyze the needs of the men and 
women given the responsibility for teacher 
training in adult basic education; and (3) to 
develop a basic design for three "trainer of 
trainers” workshops. 27 The National Associ- 
ation for Public School Adult Education devel- 
oped a guide for teacher trainers to use in 
short-term educational programs based on the 
material collected for the planning session and 
the experience gained in the three workshops. 
This guide consisted of five chapters: (1) teacher 
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training techniques in adult basic education, (2) 
characteristics of undereducated adults and how 
they affect teaching techniques, (3) curriculum 
in adult basic education classes, (4) materials, 
and (5) counseling and testing in adult basic 
education. These workshops were attended by 
165 teachers and administrators. 

In fiscal year 1S66 a change in the law made 
it possible to place increased emphasis on na- 
tional level teacher training activities. The Eco- 
nomic Opportunity Act of 1964, as amended 
under Title II 8, Section 218, provided for the 
allocation of up to 5 per cent of the total adult 
basic educatian appropriation for colleges and 
universities, state or local education agencies, 
or other appropriate public or private agencies 
organizations to provide training to persons 
engaged in or preparing to engage in the in- 
struction of undereuacated adults. With the 
cooperation of the National University Exten- 
sion Association, nine regional teacher training 
institutes were conducted in August, 1966. A 
total of 982 persons participated, 18 fewer than 
had been sought under a policy of allocating 20 
openings to each state. The intention of the 
planners was that each participant would re- 
turn to his home state and in turn provide train- 
ing for an additional 20 adult basic education 
teachers. 

In 1967, nineteen universities, including the 
9 which had been involved the previous year, 
conducted institutes for 1,197 participants. /02 
teachers and 495 administrators. 

In 1968 approximately 32 institutions offered 
federally funded workshops for 2,004 teachers, 
administrators and counselors in adult basic 
education. 

Through a contract with the National Uni- 
versity Extension Association an effort was 
made to expand the limited number of pro- 
fessionally trained teachers rapidly enough to 
staff the adult basic education programs being 
funded under the Economic Opportunity Act. 28 
Representatives of the Office of Education were 
responsible for designating one university in 
each of the nine regions of the United States 
as identified by the Department of Health, Edu- 
cation, and Welfare to conduct a four-week in- 
stitute to prepare adult basic education teach- 
ers to train other teachers, 29 The rationale 
for having the training be conducted by univer- 
sities rather than by state departments of edu- 
cation Or independent contractors was the be- 
lief that the university is the center for teacher 
training and the repository of accumulated pro- 
I * .-si on al experii.se in tie field. However, in 
.< *\ .trding contracts for teacher training pro- 



grams the Office of Education did not depend 
exclusively or primarily upon institutions which 
had been working in the field previously. 

It is certainly understandable why the funds 
provided for short-term training in adult basic 
education did not go exclusively to those insti- 
tutions with experience in the field. Apparently 
no person or group has accepted the responsi- 
bility for surveying the training opportunities 
across the United States and publicizing them 
to practitioners in adult basic education. A re- 
view of the literature did not disclose a com- 
prehensive listing of training programs in adult 
basic education. Accordingly it was necessary 
to draw from a number of sources in the de- 
velopment of an initial master listing. 

THE UNIVERSE OF 
TRAINING OPPORTUNITIES 

Table I is a listing of all of the institutions 
of higher education in the United States which 
are known to have or to have had training pro- 
grams appropriate for professional workers in 
adult basic education. The institutions are 
listed alphabetically within states and the Ptate 
groupings are arranged alphabetically. The in- 
stitutions in column 2 were identified by Sven- 
son; in column 3 by Cortright; in column 4 by 
Houle; in column 5 by the Ford Foundation for 
the purpose of conducting teacher training in 
1965; and in columns 6, 7 and 8 by the United 
States Office of Education for the purpose of 
conducting basic education short term basic 
education institutes in 1966, 1967, and 1968 
respectively; and in column 9 those institutions 
identified as offering training programs in a 
survey of state directors of adult education in 
1969. 

In November, 1968, at their meeting in Se- 
attle, the state directors of adult education 
were asked by the Chairman of the National 
Council of State Directors to cooperate in a 
national survey of the courses which were 
available for credit for adult basic education 
teachers. Through follow-up letters, telegrams, 
and telephone calls a 100% return was accom- 
plished. It should be remembered that the data 
collected reflects what state directors of adult 
education reported about the availability of 
credit programs for teachers in adult basic ed- 
ucation conducted by institutions of higher edu- 
cation in their states. 

The survey identified 80 institutions of 
higher education with credit courses in adult 
education with a range in the number of courses 
per institution from 1 to 19. 



TABLE 1. .INSTITUTIONS OFFERING TRAINING FOR PROFESSIONAL 
TEACHERS AND ADMINISTRATORS IN ADULT BASIC 
EDUCATION LISTED BY STATES AS IDENTIFIED BY 
VARIOUS SOURCES 
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TABLE 1 (Continued) 



INSTITUTIONS 


Svenson 


Cortright 


Houle 


1965 


1966 


1967 


1968 


Neff 


25 > 


Carver School of Mission & Social Work 




X 














26. 


University of Georgia 
















X 


27. 


West Georgia College 
















X 


20. 


University of Hawaii 












X 


X 




29. 


Illinois Stale Uni- • - Tty 
















X 


30. 


Northern Illinois University 










X 






X 


31. 


Northwestern University 






X 












32. 


Southern Illinois University 
















X 


33. 


University of Chicago 


X 




X 








X 


X 


34. 


University of Illinois 






X 










X 


35. 


Ball State University 














X 




36. 


Indiana Central College 




X 














37. 


Indiana University 


X 


X 


X 










X 


38. 


Iowa State University 






X 










X 


39. 


University of Iowa 


X 




X 






X 


X 


X 


40. 


Kansas State Teachers College-Emporio 














X 


X 


41. 


Kansas Slate Univeiv'i/ 
















X 


42. 


University of Kansas 


X 




X 










X 


43. 


Univer sity of Moine 












X 


X 


X 


44. 


University of Maryland 


X 






X 








X 


45. 


Boston University 






X 










X 


46. 


Harvard University 


X 




X 












47. 


Tufts College 


X 
















48. 


Michigan State University 


X 




X 










X 


49. 


University of Michigan 






X 










X 


50. 


Wayne State University 


X 








X 


X 


X 


X 


51. 


University of Minnesota 














X 


X 



o 
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TABLE I (Continued) 



INSTITUTIONS 


Svenson 


Cortright 


HouU 


1965 


1966 


1967 


1968 


Neff 


52. 


Mississippi State University 
















X 


53. 


Rust College 














X 




54. 


Southwestern Baptist Theological Seminary 




X 














55. 


University of Missouri-Columbio 


X 




X 










X 


56. 


Universityof Mi ssouri-Konsos City 












X 


X 


X 


57. 


University of Missouri-St. Louis 












X 






58. 


Municipal University of Omaho 


X 
















59. 


University of Nebrosko-Lincoln 






X 








X 


X 


60. 


University of Nebraska-Omaho 
















X 


61. 


Montclair State College 












X 


X 




62. 


Rutgers 
















X 


63. 


University of New Hampshire 
















X 


64. 


Eostern New Mexico University 
















X 


65. 


New Mexico Western College 


X 
















6/). 


University of New Mexico 








X 








X 


67. 


City College of the City University 
of New York 
















X 


O' 

00 


Corral! University 


X 




X 










X 


69. 


Hunter College 


X 
















70. 


New York University 






X 












71. 


State Univ. cf New Ycrk-Albany 










* 


X 


X 




72. 


State' Univ. of New York-Buffaio 






X 










X 


73. 


Syracuse University 


X 




X 










X 


74. 


Teachers College, Columbia Univ. 


X 




X 










X 


75. 


Yeshiva 


X 




X 












j. 


North Corolino College -Durbom 


X 
















77. 


North Corolina State University 










X 


X 


X 


X 
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TABLE l| (Continued) 



INSTITUTIONS 


Sven son 


Cortright 


Houle 


1965 


1966 


1967 


1968 


Neff 


78. 


University ot North Carolina- 
Chapel Hill 


















79. 


Winston Salem State College 
















X 


80. 


North Dakota State University 














X 


X 


81. 


University of North Dakota 
















X 


82. 


Kent State University 
















X 


83. 


Ohio State University 


X 




X 










X 


84, 


Un iversi ty af Akron 
















X 


85. 


Western Reserve University 


X 
















86. 


Oklahoma State University 
















X 


87. 


University of Oklahoma 












X 


X 


X 


88. 


Oregon College of Education 














X 


X 


89. 


Oregon State College 


X 
















90. 


Oregon State University 
















X 


91. 


Portland State College 












X 


X 


X 


92. 


University of Oregon 
















X 


93. 


Marywood College 














X 




94. 


Pennsylvania State University 
















X 


95. 


Tempi e University 
















X 


96 


University of Pittsburgh 






X 












97. 


Upland College 




X 














98. 


University af Rhode Island 
















X 


99. 


University af South Carolina 












X 


X 


X 


100. 


South Dakota State College 














X 




101. 


George Peabody College for Teachers 


X 
















102. 


Memphis State University 














X 


X 


103. 


University of Tennessee 
















X 


3 


Baylar University 




X 
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>ABLE I (Continued) 



INSTITUTIONS 


Sven son 


Cortright 


Houle 


1965 


1966 


1967 


1968 


Neff 


105, 


Southern Methodist University 




X 














106. 


Texas Christian University 


X 
















107. 


Texas Technological University 






X 












108. 


University of Texas 






X 




X 


X 


X 


X 


109. 


Brigham Young University 
















X 


no. 


University of Utah 


















in. 


Utah State University 
















X 


112. 


R ; chmond Public Schools 














X 




113. 


University of Virginia 




X 














t <4. 


Central Washington State College 
















X 


115. 


State College of Washington 


X 
















1 16 . 


Seattle University 
















X 


117. 


University of Washington 








X 








X 


118, 


Washington Stote University 
















X 


119. 


Western Washington State College 
















X 


120. 


University of Vrsconsin-Madi son 


X 




X 












121, 


University of Wi aConsin-Milwaukee 






X 












122. 


University of Wyoming 






X 






X 


X 


X 


123. 


University of Puerto Rico-Mayoguez 
















X 


124. 

i 


University 0 f Puerto Rico-Rio Piedras 
















X 




IS 






TABLE 2. NUMBER OF INSTITUTIONS OF HIGHER EDUCATION 
OFFERING DIFFERENT NUMBERS OF CREDIT 
COURSES IN ADULT EDUCATION 



" - ■ 


Number of Institutions 


Number of Courses Offered 




If 


1 




16 


2 




10 


3 




5 


4 




4 


5 




2 


7 




15 


8 or more 





Table 2 shows the wide range in the number 
of training opportunities at the 80 institutions. 
The university with the largest number of 
courses in adult education listed 19. 

The following five institutions were reported 
to have the largest number of courses bearing 
an adult education designation: Florida State 
University, District of Columbia Teachers Col- 
lege, George Washington University, North 
Carolina State University at Raleigh, and In- 
diana University. 

Academic preparation opportunities for adult 
educators are unevenly distributed in the United 
States. Four states (California, Illinois, New 
York and Washington) and the District of Co- 
lumbia each have 5 institutions of higher learn* 
ing offering adult education courses. At the 
other extreme, it was reported that eleven 
states had no institutions offering course work 
in adult education: Alaska, Arkansas, Hawaii, 
Idaho, Louisiana, Montana, Nevada, South Da* 
kota, Vermont, Virginia, and West Virginia. 

The state directors identified 58 per cent of 
the institutions on Svenson’s list, 14 per cent of 
the institutions on Cortright’s list, and 64 per 
cent of the institutions on Houle’s list. There 
seemed to be some difference between the per* 
ception of the Office of Education and the state 
directors of adult education concerning training 
opportunities. Although the directors listed 67 
per cent of the institutions which had conducted 
federally funded workshops in J.966 and 1967, 
in 1968 they named 48 per cent of the universi* 
ties providing federally funded training. This 
discrepancy is worthy of careful consideration. 

In the effort to accelerate the training of 
adult basic education teachers the Office of Ed- 
ucation awarded contracts to institutions which 
hed expressed an interest L* conducting such 
work. A number of these federally funded work* 

o 




shops were carried on at institutions without a 
history of involvement in such activity. In 1968 
33 per cent of the institutions receiving federal 
funds to conduct training programs in adult 
basic education had conferred one or more doc- 
toral degrees in adult education. In 1967 it dropped 
again to 26 per cent. Clearly the federal funds 
were being used in these cases not for the pur- 
pose of strengthening existing graduate adult 
education programs but rather to provide the 
financial incentive for establishing adult basic 
education programs at institutions which pre- 
viously had appeared unconcerned about the need. 

It is too early to tell what lasting effect the 
federally provided incentives will have on the 
expansion of stable programs for the training 
of adult basic education teachers, administra- 
tors and other professional personnel. An ex- 
amination of Table I does, however, seem to 
lead to the conclusion that maximum advantage 
is not now being taken of existing training pro- 
grams. 

Training programs for adult basic education 
teachers become training opportunities only 
as teachers or potential teachers become ac- 
quainted with such programs. Because of the 
relative newness of scale adult basic edu- 
cation programs, the teachers employed to staff 
the programs have had little formal preparation 
in adult education and have only limited ac- 
quaintance with institutions prepared to supply 
such training. These neophyte adult basic edu* 
cation teachers look to their administrators for 
assistance in diagnosing strengths and weak* 
nesses in the programs and in identifying col- 
leges, universities and other organizations 
which may be conducting preservice and in* 
service programs in adult education. In turn the 
local administrators, whose academic prepara* 
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tion and experience frequently is in fields other 
than adult education, look to the state level 
leadership emanating from the staff of the chief 
state school officer. 

What is of practical significance is not how 
many programs of professional preparation are 
offered by institutions of higher education, but 
instead how many of the present ami prospec- 
tive adult basic education teachers know about 
the programs so they can make an informed 
judgment concerning their own preparation for 
their tasks. And it is at this point that the state 
director of adult basic education plays a pivotal 
role. If he is well acquainted with the range of 
training opportunities available he can dissemi- 
nate this information to local program adminis- 
trators and teachers. Tnis dissemination itself 
is a demonstration of his belief in the value of 
such training and serves to encourage partici- 
pation. On the other hand, if he is ill-informed 
and therefore unable to promote participation 
in professional improvement programs this fact 
will be sensed by the local program people. A 
part of the problem is traceable to disagree- 
ment over both whether any formal training is 
required for adult basic education personnel 
and what the content of such training ought to be. 

Confusion, debate and disagreement have 
characterized the discussions of the most ap- 
propriate curriculum for the training of adult 
education teachers, The temptation is to offer 
training in methcu skills, such as the use of 
the discussion method and audio-visual aids 
This approach is usually welcomed by the 
trainc for through the development of such 
skih-j they develop a beginner’s confidence. It 
may be, however, that fcr those who already 
have some experience, the purpose of the train- 
ing should be to stimulate the teacher to engage 
in a continuing reexamination of his work 
searching for useful information and striving 
to improve his performance. 

Most of the teaching being done in adult 
basic education classes in the United States is 
being done by teachers who have had academic 
preparation of some sort, but rarely by those 
who have gone through an extended period of 
education designed specifically to prepare them 
to work in adult literacy. Frequently teuchers 
cf illiterate adults are drawn from among the 
elementary teachers in the area. The justifica- 
tion for this approach is based on the level of 
the content to be taught and not on a considera- 
tion of the similarities and differences between 
the two groups of learners. Should there be 
special training programs for teachers of 
adults? Ft does not seem unreasonable to as- 
that special standards would he appropri- 



ate for teachers of adults just as special stand- 
ards have already been established for teachers 
who work in elementary, secondary and special 
education programs. 30 

Aduit education has been regarded histori- 
cally as more of a movement than a profession. 
The absence of universally acceptable profes- 
sional standards — measures of proficiencey and 
accomplishment — makes it difficult for the 
public to recognize competency in adult educa- 
tors. As a consequence, the field is not accorded 
the status and importance in the public mind that 
is accorded other professional groups. 

In addition to the problem of a lack of agree- 
ment regarding standards in the field is the re- 
luctance of the old line volunteers to accept the 
notion that something more than emotion, de- 
dication, and experience is required before the 
appellation professional may be used legiti- 
mately. The continuing overly romantic ap- 
proach of volunteers is consistent with the posi- 
tion that adult educators should be trained only 
by direct work experience with those already 
on the job. Nevertheless, training programs 
for adult educators manage to turn out a small 
number of graduates annually. 

In his 1968 education message to the Con- 
gress President Johnson presented proposals 
for the strengthening of education through the 
provision of special federal funds for the devel- 
opment of the education professions. He warned 
that “It would profit us little to enact the most 
enlightened laws, to authorize great sums of 
money — unless we guarantee a continuing sup- 
ply of trained, dedicated, enthusiastic men and 
women for the education professions. 31 

Dedication and enthusiasm abound among 
those who teach and administer adult basic edu- 
cation programs, but these two attributes are 
infrequently found to be accompanied by high 
levels of training. The lack of well-prepared 
professionals has made it possible for a wide 
variety of individuals from various institutions 
with various levels of competence to rise to 
prominence. At least one professor of adult 
education has lamented the elevation of pseudo- 
professionals: 

Unfortunately, many who loudly proclaim 
their expertise are not knowledgeable about 
the field of adult education in general nor 
the area of adult basic education in particu- 
lar. To put our reliance on ‘experts’ from 
other fields, who may assume that because 
it works with kids, or prisoners, or sol- 
diers, or what-have-you, is unsound unless 
we first thoroughly satisfy ourselves that 
the ‘expert’ has the understanding, know- 



ledge and competence that we are looking 

for. 32 

The lack of commonly accepted criteria for 
identifying competence in adult basic education 
practitioners has been treated by the Xerox 
Corporation in its report on a study of adult 
basic education programs in ten states: "A 
continuing attack on the problem of teacher 
preparation is required including the setting of 
certification standards by state education de- 
partments. The Federal Government should 
undertake a program to professionalize the 
whole area of adult basic education.” 33 

At the time the Xerox study wa9 conducted 
there were 1/.73 local adult basic education 
programs in the United States. 34 Ninety-three 
per cent of the 304 teachers interviewed in the 
study were college graduates, but few had pur- 
sued any appreciable amount of formal training 
in adult basic education. 35 

In examining the opportunities for preser- 
vice and in-service education for adult educators 
working in industry, Whitlock emphasized the 
idea that a novice does not become an effective 
professional solely through participation in any 
seminar, conference, institute or short course. 
Further, he decried the number of programs 
which are being promoted for the teaching of 
particular training techniques because the act 
of holding such training sessions may be in- 
terpreted by participants and observers as evid- 
ence that sufficient research has been done on 
the use of a particular technique to warrant 
such training. 36 

Even though the importance of special edu- 
cation preparation and certification for all kinds 
of professionals and paraprofessionals in che 
United States appears to be increasing, the wis- 
dom of the trend is not universally accepted by 
those who have looked at the adult education 
field. In reviewing the preparation of adult edu- 
cation teachers, the Overstreets noted that 
those who have become teachers of adults have 
done so more as a result of selection process 
than a training process. 37 Further, they pre- 
dicted that this situation would persist. Not 
everyone is in favor of abandoning the present 
practice of selecting teachers and moving to- 
ward highly formalized programs of academic 
pre-service education. There is practical wis- 
dom in selecting persons to be full-time adult 
education teachers from the most successful 



part-timers. Because the research findings 
have not demonstrated the superiority of any 
discrete procedure for training effective adult 
education teachers, the possibility cannot be 
overlooked that selection may be at least as 
important as training in the staffing of an adult 
basic education program. It is possible that in- 
creased emphasis should be placed on the use 
of a probationary period for adult basic educa- 
tion teachers. Such an approach would be con- 
sistent with the assumption that the character- 
istics associated with successful teaching in 
adult basic education are more dependent upon 
character and personality than upon formal 
training. 

Graduate programs in adult education typi- 
cally have served those who already have prac- 
tical experience in the field. In a sense, adult 
educators discover a need for formal training 
only after they have been engaged in some ac- 
tion phase of the field. Undergraduate programs 
providing preservice education have not de- 
veloped primarily because career employment 
opportunities in the field have not existed in 
sufficient numbers to attract the attention of 
faculty members in the majority of teacher 
training institutions or of high school students 
making career choices. 

IMPLICATIONS AND SUGGESTIONS 

Teacher training in adult basic education is 
still an activity lacking a common institutional 
form. Persons seeking academic preparation 
for a career in adult basic education may choose 
from at least three approaches. It is unlikely 
that all three are of equal utility; yet it is not 
clear which approach is best suited for present 
and future needs. Accordingly, efforts to im- 
prove communications among the three groups 
providing training ought to be encouraged. When 
training proposals are reviewed, special at- 
tention should be given to the provisions which 
have been planned for drawing upon the best 
experience in all three groups. Finally, until 
such time that it can be established that one 
approach is superior to the others, adult basic 
education leaders in the United States Office of 
Education should devise means of assuring that 
ail state and local administrators associated 
with adult basic education programs will be 
adequately informed of the existence of training 
opportunities. 
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MEASURING THE EDUCATIONAL RELEVANCE OF A SHORT-TERM 
TRAINING PROGRAM FOR TEACHERS 

Raymond L. Johnson, 

Richard W. Cortright, and 



Robert S. 

Introduction: The Practical Problems 
of Evaluation. 

One of tht common requirements for the 
approval of proposals to develop special train- 
ing programs for adult basic education teachers 
is a final evaluation to demonstrate the effec- 
tiveness of the course. This requirement is 
frequently pro fo:rna ana a minimal evaluation 
is accepted. Very often the need for an eval- 
uation is fulfilled oy appending to the final re- 
port a collection of enthusiastic testimonials 
written by the participants at the completion 
of the course. 

The agencies which have been funding 
short-term teacher training programs have 
been so accommodating in accepting teacher 
testimonials as eudence of program effective- 
ness that the approach to evaluation has almost 
taken on an aura of credibility, as indicated by 
a training manual published in 1966/ The man- 
ual outlined the organization and content of a 
model five-day training program in substantial 
detail touching on teaching methods and mater- 
ials, student assessment and counseling, and 
the psychology of the disadvantaged adult. 

Throughout the manual, the authors stress- 
ed the tentative nature of their curiculuin pro- 
posals and suggestions and were quick to ac- 
knowledge that little was known about training 
in this field. Yet they also emphasized that to 
obtain a valid assessment of program effec- 
tiveness, data must be systematically collected 
over a period of time — a procedure character- 
ized as being both “exhaustive and exhausting/’ 
In discussing feasible alternative approaches, 
a section on evaluative procedures oescribed 
five methods for polling teacher trainees for 
their reactions to the program. Unfortunately, 
all the methods discussed rely entirely upon 
the teachers 1 subjective judgments about what 
is relevant and useful. No method was offered 
for obtaining information which would permit a 
S3 
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more impartial and impersonal evaluation of 
the course. 

The omission of other means of date col- 
lection is understandable, of course, since the 
classic experimental designs for evaluation 
studies involve elaborate provisions for follow- 
up. Withall and Fagan’s evaluation of a National 
Defense Education Act (NDEA) summer institute 
included content-analysis of tapes of classroom 
verbal interactions recorded before and after 
the teachers attended the institute. 2 This anal- 
ysis was supplemented by extensive supplemen- 
tary data obtained dunng observations of class- 
room behavior. Clearly, the commitment of 
resources necessary for such research is pro- 
hibitive for the ordinary short-term teacher- 
training program. The cost of a thorough eval- 
uation study could easily exceed the cost of the 
training program itself by a considerable mar- 
gin. A serious question is raised — i9 the high 
quality of the information gained by using a 
rigorous experimental design worth its high 
cost, especially when the training course will 
have been completed long before the results of 
the evaluation are known? 

Purpose: The Development of an 
Evaluative Procedure 

The study presented in this paper attempt- 
ed to find a compromise approach to evaluation 
which will not pacify the purists in experimen- 
tal design, but which will be more defensible 
than teacher testimonials. The aim was to de- 
velop a relatively simple and economical pro- 
cedure of data collection and analysis suitable 
for the routine, moderately-budgeted teacher- 
training program. 

Procedure 

The population for this study was sixty- 
three suburban housewives who had been re- 
cruited to teach basic reading to adults. Prior 
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to receiving their teaching assignments, the 
subjects were required to attend a nine-hour 
workshop, held over a three-day period by the 
staff of a Milwaukee-based company which spe- 
cialized in training programs. The content and 
organization of the course was carefully planned 
in advance and a questionnaire was constructed 
which sampled course content. The question- 
naire v.’r 3 constructed which sampled course 
content. The questionnaire consisted of 100 
true-false items dealing with (1) teachers’ atti- 
tudes toward adult illiterates, (2) teachers, 
opinions about adult basic education student 
characteristics, and (3) the most successful 
methods of teaching and motivating ABE stu- 
dents. 

Each teacher trainee answered the survey 
on three separate occasions. All subjects com- 
pleted it at the very beginning and at the end of 
the nine-hour workshop, designated as Time 
One (Tl) and Time Two (T2). Prior to the work- 
shop forty-three of the participants were ran- 
domly assigned to an experimental group, and 
the remaining twenty were assigned to a con* 
trol group. Following the workshop, subjects in 
the experimental group were immediately as- 
signed to small adult basic education classes 
and began to teach two hours a week under 
close professional supervision. After ten weeks 
of teaching experience the experimental group 
again completed the attitude and opinion survey, 
designated as Time Three (T3). 

In contrast, subjects in the control group 
did no teaching whatever during this period and 
were assigned classes only when they had com- 
pleted the survey at Time Three, ten weeks 
after the workshop. 

Design 

The technique of giving the survey at three 
different times to the experimental and control 
groups with teaching experience intervening be- 
tween Time Two and Time Three for the experi- 
mental group has been described as a multiple- 
time-series design with a non-equivalent control 
group. 3 The reason for selecting this design 
was to permit the effect of teaching experience 
on attitudes to be twice demonstrated: once by 
comparing the experimental subjects who 
taught with the controls who did not; and by 
comparing the experimental subjects with them- 
selves, before and after the teaching experience. 

The analysis of data collected, using this 
design, enabled the researchers to ask two main 
questions: (1) Was the short nine-hour workshop 
effective in bringing about changes in teacher 
attitudes and opinions? And if so, (2) Did these 
O 




changes persist er were they merely transi- 
tory, with teachers eventually returning to their 
original views? The answers to these two ques- 
tions were important because they bore on a 
definition of educational relevance in the teacher- 
training situation based on the premise that to 
be considered relevant, the content of a train- 
ing course should provide teachers with expec- 
tations about their future students and the 
teaching experience itself which are later con- 
firmed when the teacher actually begins to 
deal with students. That is to say, the changes 
in attitude end opinion which are induced by the 
course should show signs of permanence, be 
“locked in” by the subsequent teaching experi- 
ence. The evaluative procedure in this study 
was based on this definition of educational 
relevance. Formulating a criterion for course 
evaluation in terms of consistency of change 
observed over time helped to set explicit per- 
formance standards for the course before it 
was held. 

Data Analysis 

The educational relevance evaluative cri- 
terion requires that changes in the teachers’ re- 
sponses to the survey i ; charted over time. 
This ’.van accomplished by constructing for each 
item a pair of turnover tables. The method is 
illustrated in fugure 1. The turnover table on 
the left shews the response shifts of the forty- 
three teachers in the experimental group be 
tween the beginning and the end of the training 
workshop, that is, between Time One and Time 
Two. The number in the lower right-hand cell 
corresponds to the number of teachers who be- 
lieved this particular item was false at the be- 
ginning and had not changed their minds at the 
2 nd of the workshop. In the upper left-hand cell 
is the number of teachers who, on both occa- 
sions, believed this item to be true. The two re- 
maining cells were used to record teachers who 
shifted in their responses over the two obser- 
vations. In the lower left-hand cell are entered 
those who shifted from false to true, (Sft) and in 
the upper right-hand cell those who shifted 
from true to false (Stf). 

On examining the marginal sums, it can be 
seen that at the beginning of the workshop, the 
teachers’ views on this item were nearly evenly 
split, 22 to 21. But the workshop seemed to have 
some effect in increasing the number of false 
■esponses to 26 at Time Two. 

An emergent consensus that the item was 
false is seen in the turnover table on the right 
which shows response shifts between Time TSvo 
and Time Three. After ten weeks of classroom 
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Fig. 1. “Students often secretly resent their teachers’ education and higher social status. 



experience thirty of the forty-three teachers be- 
lieved the item to be false, and only thirteen 
continued to hold the opx>oA\g view. Moreover, 
the strength of the minority view had steadily 
dwindled. Six teachers had shifted from false 
to true between Time One and Time Two, but 
only four had defected to the minority view be- 
tween Time Two and Time Three. 

It is convenient to express these shifts 
over time as transition rates. There are a num- 
ber of ways to compute these transition rates. 
One of the most sophisticated means is a stoch- 
astic model proposed by Coleman in his book on 
mathematical models in sociology . 4 Coleman 
has called this model a continuous time, dis- 
crete-state model with random shocks which 
assumes that in a state of relative equilibrium 
there exist ‘^random shocks'" which are con- 
tinuously moving a certain number of respond- 
ents from one cell to another in a turnover 
table. When the relative equilibrium is disturb- 
ed, for example by an effect of the experiment 
tal treatment, the result is an increase in 
movement, relative to the random shock rate, 
from one cell to another. The model permits 
exact estimates of transitions in two-state 
turnover; in this cese, the transition rates 
from true to false and from false to true, 

o 



which can be attributed to the effects of the 
training program and teaching experience. 
For the data described in this study, however, 
a simpler method was used to compute transi- 
tion rates, one involving the calculation of 
weighted proportions. This procedure has been 
more fully discussed elsewhere . 5 

The Evaluation Criterion 

Once the two transition rates for each 
turnover table have been calculated, the eval- 
uative criterion can be applied. The criterion 
consists of two rules which are jointly invoked 
Rule One states that the direction of the shift 
observed between Time One anu Time Two 
must remain constant from Two to Time 

Three; there must be no reversion at Time 
Three toward the original Time One distribu- 
tion of responses. Instead, there must be evi- 
dence of a continuing shift at Time Two and 
Time Three to new distributions 'jven further 
removed from the original one at Time One. 
Rule Two states that when a consistent migra- 
tion is observed over time, the rate of change 
running counter to the dominant trend must show 
a corresponding reduction over time, that is, 
the rate of transition in a direction counter- 



vailing to the dominant tiend must be inhibited. 
An item which exhibits convergent agreement 
over time indicates that this information, learned 
in the training course, was found to be consist- 
ent with the teacher’s own experiences in actual 
instruction and thus to have educational rele- 
vance. Appendix A outlines the evaluative pro- 
cedure developed for this study. 

Rules One and Two find compliance in the 
pair of turnover tables for figure 1. The transi- 
tion rates for the shift from true to false are 
larger than the shift from false to true, both 
between Time One and Time Two and between 
Time Tw' ^ Time Three. This shift from 
true to fai ams the dominant trend and it was 
consistent over time. In contrast, the rate of 
change running in the opposite direction shows 
a reduction over time. The rate of the shift 
from false to true between Time Two and Time 
Three is less than it was earlier, between Time 
One and Time Two. 

For the sake of comparison, an example 
of an item which failed to meet the joint criter- 
ion has been included. (See figure 2). In the 
turnover tables in figure 2, the shift from false 
to true which occurred between the beginning 
and end of the workshop was almost completely 
reversed by Time Three. The response distri- 
butions of Time One and Time Three are al- 
most identical, and both are quite different from 
the distribution at Time Two. Thus, no cumula- 
tive agreement over time was observed to occur. 



Results; A Negative Evaluation 
with Positive Aspects 

When the method outlined in this paper was 
used to assess the effectiveness of the nine-hour 
workshop, it became apparent that the proce- 
dure imposed a very stringent test; the per- 
formance standard was set quite high. First of 
all, it was clear that the workshop did have a 
discernible, if modest, effect in altering teach- 
ers' attitudes and opinions. Sixteen of the one 
hundred items showed significant shifts in re- 
sponses between Time One and Time Two for 
the experimental group and fourteen shifted 
significantly in the control group. Statistical 
significance was estimated using the bincmial 
test. Furthermore, virtually all of the changes 
induced in the controls were found to persist at 
lime Three, a finding which suggests that even 
short-term courses lasting only a few hours 
are potentially useful as agents of attitude 
change. 

That short-term training is potentially 
useful should be stressed, because in this case 
the effects of the workshop were almost totally 
erased by the experiences in the classroom. 
Among teachers in the experim 1 group, the 
effect of teaching appeared t< \ ' rteen of 

the sixteen items which had f . hanged 

during the workshop to n lie origi- 

nal, pretraining distribution*. 

When the joint evalua ^ n was ap- 



Time 2 



f 



23 


2 


12 


6 



35 . 8 



$ lf = .082 
Sft - 



25 



Time 2 



25 



2 



27 



5 tf = .440 
$ f| r .089 



•5 



3 
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plied to the experimental group data, it was 
found thi only seven of the one hundred items 
exhibited dilative agreement over the three 
observations, and in five of the seven instances, 
the largest shifts occurred between Time Two 
and Time Three, coincident with teaching ex- 
perience and not with training. The content of 
the workshop must therefore be judged to have 
been, in large part, irrelevant — even incom- 
patible — with what the teachers learned them- 
selves from their contacts with adult students. 

Although the evaluation of the nine-hour 
teacher* training workshop under consideration 
proved to be negative, the results do provide 



useful guidelines for revising course content 
and organization. Those items, wnich showed 
cumulative consensus identify topics which can 
be elaborated upon and given greater emphasis 
in the future. On the other hand, those items 
which exhibited a strong reversal pattern help 
(c isolate elements of course content which 
should be reconsidered, perhaps even omitted. 
The authors’ conclusion is that the evaluative 
procedure developed for this study can pvovide 
essentia] feedback to assist in the gradual shap 
ing of course content into effective training 
efforts. 





?$ 



APPENDIX A 



Outline of Procedure for Measuring the Educational 
Relevance of A Short Term Training Program 



Construct a test or questionnaire to sample 
the content of the training course. Re- 
sponses are d'chotomous, that is, true or 
false, first or second alternatives on 
multiple-choice questions. 

Administer the instrument at the beginning 
(Tl) and end (T2) of training the course, 
and again after the participants have ac- 
quired some posttraining teaching experi- 
ence. (T3). 

Summarize the responses to each item in 
parts of turnover tables. Response fre- 
quencies are entered in the cells of a 2 x 2 
table, with the upper left-hand and lower 
right-hand cells showing the number of 
teachers who did not change their responses 
to an item on the two occasions. The upper 
right-hand cell shows the number who said 
that the item was true but subsequently 
changed their response to false. The 
low f er left-hand cell shows the number who 
changed from falsa to true. 

Compute the transition rates from true to 
false (Stf) and from false to true (Sft) be- 
tween Tl T2 and T2 T3. Among several 
alternative procedures for computing 
transition rates are: 



A. Weighted proportions. 1 

B. Values determined by a continous time, 
discrete-rtatc model dth random 
shocks. 2 

V. The binomial test may \ .ed to estimate 
whether a shift between Tl T2 or T2 T3 
was statistically significant. This step is 
optional. 

VI. Examine the pair of transition rates cab 
culated for each item, and apply the fob 
lowing joint-criterion: 

A lire direction of the shift observed be- 
tween Tl and T2 must remain constant 
from T2 to T3. There should be no re- 
version at T3 toward the original Tl 
distribution of responses. Instead, 
there must be evidence of a continual 
shift at T2 and T3 to new distributions 
even further removed from the origi- 
nal one at Tl. 

B. When a consistent migration is observed 
over time, the rate of change running 
counter to the dominant trend must 
show a corresponding reduction o\er 
time, that is, the rate of transition in 
a direction countervailing to the dom- 
inant trend is inhibited. 
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THE RECRUITMENT AND TRAINING OF PROFESSIONAL STAFF 
FOR AN ADULT BASIC EDUCATION LEARNING CENTER 

Fay J. Ast 



The adult basic education learning center, 
encompassing a learning lab, is a relatively 
new approach to serving basic educational needs 
of our adult population. Recent literature, though 
limited, offers us some factors for considera- 
tion in attempting to identify objectives, or- 
ganizational and structural patterns, and tech- 
nological aids, as well as services related to 
the development of adult basic education learn- 
ing centers having learning lab components. 
Discussions among practicing adult educators, 
attesting to the effectiveness of the learning 
center approach in adult basic education, point 
up clearly the variety of conceptions and mis- 
cc.iceptions prevalent at this early stage of 
center development. 

This presentation will attempt to focus upon 
several very real organizational and personnel 
concerns growing out of experiences encoun- 
tered in New Jersey while initiating full-time 
operational adult basic education learning cen- 
ters in the target population areas of Newark 
and Camden. Supplementcry reference where 
relevant will be made to earlier pilot adult basic 
education mini leaming lab projects on the cam- 
pus of Montclair State College and at the New 
Jersey Greystone State Hospital. 

Adult basic education learning centers in 
New Jersey have been initiated under the con- 
ception that a learning center is a most care- 
fully structured organization of administrative, 
instructional, and counseling personnel, and 
selected instructional materials and equip- 
ment, as well as other related services the 
adult student may need. This structured or- 
ganization is designed to be easily accessible 
for the adult at any time of day or evening. 
The structural pattern must be organized so 
that a completely flexible schedule of operation 
will meet the individual adult’s interest, desire, 
or need. The primary focus of all personnel, 
all services, and all materials or equipment 
is upon the complete individualization of as- 
sistance to the adult from his instructional pro- 
gram design to whatever social, economic, or 
welfare referrals he may need. 







On ihe basis of our experience, I belie- *e 
that the foundation of a successful adult basic 
education learning center operation is the most 
careful recruitment and training of staff per- 
sonnel. However, this foundation cannot be 
formed until a realistic definition and delinea- 
tion has been established of learning center job 
tasks for each of the personnel needed. Simple 
job titles can be misleading. The delineation of 
job task responsibilities becomes necessary to 
prevent the recurrence of some of the tradi- 
tional, less effective, approaches in working 
with the adult basic education learner. 

The administrative leadership position for 
a learning center shall be called the ABE learn- 
ing center director. This position involves a 
list of tasks or respons.bilities that the direc- 
tor undertakes that will serve as a guide in 
determining the specific personal and profes- 
sional qualities of the candidate for the position. 
The director will be “responsible for the direct 
administrative, supervisory and continuing 
evaluative activities in the center’s operation.” 1 
A delineation of the board categories of ad- 
ministration and supervision shows many speci- 
fic areas of training need, preservice as well 
as in-service, for our qualified candidate. 
Among examples of his job responsibilities in 
the New Jersey Project, the following are but 
a few. 

1. Recruitment, interviewing, selection and re- 
commendation of personnel to staff the local 
ABE learning center. 

2. Formulate, and administer, such operational 
patterns and evaluative procedures, as are 
necessary to insure a continuity of effective 
performance of the local learning center. 

3. Supervise the day-to-day conduct and opera- 
tion of the local learning center. 

4. Establish, and maintain, effective working 
relationship of the local learning center 
with MDTA Multi-Skill Center, as well as 
with other agencies and programs deemed 
to be desirable and necessary, including: 
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college adult education resource centers, 
employment services, local public schools 
A.B.E. programs, model cities projects, 
welfare programs, C.A.P. programs, etc. 

5. Develop such instruments, and procedures, 
to implement the “instructional materials, 
equipment and techniques” continuing eval- 
uation phase of an ABE learning center. 

6. Insure the collection, processing, and eval- 
uation of such information and data as is 
necessary to the success of the learning 
center. 

7. Provide appropriate assignment, training, 
guidance, professional help and assistance 
to local learning center personnel. 

8. Promote, and publicize, the local learning 
•"enter's activities to insure maximum co- 
operation and support within the community. 

9. Develop procedures, and supervise such 
procedures of the local center, for the se- 
lection, ordering, distribution, maintenance 
and servicing, evaluation, storage and in- 
ventory control of supplies, instructional 
materials and equipment. 

10. Assume such office management responsi- 
bility as to insure effective operation of 
center. 



A description of the responsibilities cf sev- 
eral of these positions nay help focus attention 
upon the training needs of lab specialists, coun- 
selors, and instructs. A realistic design to 
meet the direct training needs of the profes- 
sional personnel of learning centers is an ino- 
perative task for our colleges and universities. 

The definition of the job responsibilities of 
the learning center guidance counselor as out- 
lined in the New Jersey project is “Under the 
direction of the ABE Learning Center Director, 
he will assume the responsibility for develop 
ment and implemenation of such guidance and 
counseling services, and activities, as deemed 
necessary to the effective functioning of the 
Learning Center program.” 3 A few of the re- 
sponsibilities that this definition includes are 
the following; 

1. Assume responsibility for the development 
and implementation of procedures, techni- 
ques and instruments needed for effective 
and efficient introduction, enrollment and 
placement of students into an individualized 
program of learning at the center 

2. Assume responsibility for developing and 
implementing a complete program of ori- 
entation as to purposes, objectives and me- 
chanics of the center for each prospective 
student at his enrollment. 



11. Maintain essential recordr and files, as well 
as prepare such reports and studies as are 
necessary to the effective development of 
the learning center. 

12. Carry on such activities as to provide for 
his own as well as the staffs professional 
development, including reading, adult edu- 
cation conference participation, and the de- 
velopment of a functional professional li- 
brary at the center. 5 



ERjt 



In addition to such defined responsibilities 
the learning center director must have the lead- 
ership capability for creating a team effort 
among all personnel of the center. The diverse, 
yet wholly interrelated, tasks of the center’? 
staff must be melded to ^chieve maximum ef- 
fectiveness for the adult learner. 

Other positions for which a careful delinea- 
tion of responsibility must be made include 
♦hose of the learning center counselor, lab spe- 
cialist, lab aide, learning center instructor, and 
instructional aide, as well as the clerical and 
accounting positions required for effective 
center operation. 
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3. Select and administer such tests and other 
instruments cf evaluation necessary to the 
determination of each student's placement, 
as well as his progress. 

4. Develop, and implement, e comprehensive 

referral program to community agencies so 
as to provide ihe most effective assistance 
to students vocational, social, welfare, 
legal, hea. . :tc., needs and interests. 

5. Develop anu implement effective follow-up 
procedures for students in the learning 
center program. 

6. Assist the learning center director develop 
and implement effective interrelationships 
among counselor, instructor and learning 
lab specialist, promoting a maxim m of 
individualized learning experience oppor- 
tunity for the student. 

7. Prepare and maintain such :ecords, forms 
and reports necessary to the successful 
program functioning for the adult student. 

8. Carry on such activities as to provide for 
his continuous professional growth and de- 
velopment. 4 



Th<. learning lab specialist's position is as 
unique and as demanding as that of any other 
position at a learning center. With respect to 
his efforts in creating and developing the most 
effective uses of educational technology to serve 
the in divi dualized needs of the adult Btudent, the 
lab specialist’s job is extremely complex, re- 
quiring considerable preservice and in-service 
training. As developed in the New Jersey pro- 
ject, the definition of learning lab specialist is 
quite comprehensive: “Under the direction of 
the ABE Learning Center Director, will co- 
ordinate, manage and supervise all artivities 
in the learning laboratory of the ABE Learning 
Center.” 5 A description of his responsibilities 
includes: 



1- Assist the learning center director estab- 
lish procedures, methods and techniques for 
the effective functioning of the learning lab- 
oratory within the local ABE learning 
center. 

2. Assume rtc'pons bility for tin operational 
management and supervision of activities 
within the ’earning laboratory, including 
the scheduling of students into the learning 
lab, as well as supervision of learning lab 
aides. 

3. Assist the learning center director to pro- 
vide preservice and in-service training ex- 
periences for professionals and para-pro- 
fessionals for effective utilization of learning 
lab equipment and instructional materials. 

4. Assisi the learning center director and the 
guidance counselor develop and implement 
procedures for the effective placement of 
students into the learning center’s edu- 
cational program. 

5. Assume responsibilities in developing pro- 
cedures and instruments to aid effective 
diagnosis of the individualized, instructional 
needs of the adult students assigned to the 
learning lab, and, provide for the appropri- 
ate learning activity. 

6. Develop procedures far the continuous eval- 
uation of student needs and achievement, 
including such record keeping system nec- 
essary. 

7. Assist the ABF] learning center director 
develop such instruments, and procedures, 
to implement the “ .nstructional materials, 
equipment and techniques” continuing eva- 
luation phase of the learning center. 
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8. Assist the learning center director in the 
selection, use, evaluation and inventory con- 
trol of instructional materials and equipment 
nccessrry to effective operation of learning 
lab. 

9. Prepare such records, forms, files and re- 
ports necessary for the efficient functioning 
of the learning center. 

10. Supervise the activities of the learning lab 
aides. 

11. Carry on such activities as to provide for 
his continual professional development and 
growth. 6 

In an ABE learning center the job of the 
learning center instructor has a quality that is 
not found in the more traditional ABE class- 
room situations. His background of teaching 
experience must be carefully examined. Pre- 
service training in riontraditional methods is 
absolutely imperative for the instructor to as- 
sure his overcoming many of the traditional 
school practices which could minimize the ef- 
fectiveness of the center’s services to the adult 
students. The learning center instructor in the 
New Jersey project is a key person in the im* 
pl?mentation of an indivi dualized program clan 
loi* each adult student. 

Under the New Jersey Learning Center Pro- 
ject the job definition of the learning center in- 
structor is stated as follows: “Under the direc- 
tion of the ABE Learning Center Director, and, 
in a close working relationship to the Learning 
Lab Specialsit, the student, and the Guidance 
Counselor, will "repare an individualized pro- 
gram plan, and guide the individualized learn- 
ing experiences of the student placed into the 
Learning Center program, based upon each 
student’s immediate needs. He will be respon- 
sible for a continuous and/or periodic review’ 
of each program plan as the student pro- 
gresses.” 7 Some examples of the responsibi- 
lities of the instructor, working in a particularly 
close relationship with the student, the lab 
specialist, and the counselor, follow: 

1. Plan and organize with the student, counse- 
lor and lab specialist, a program of indi- 
vidualized learning experience for each 
student assigned, utilizing selective pro- 
grammed and individualized instructional 
materials suitable to the student. 

2. Assist the learning center director in the 
development and implementation of “ma- 
terials and techniques” evaluation proce- 
dures preparing such recurds and reports 
necessary to the center. 




3. Assume responsibility for maintaining such 
records and reports of student progress, 
attendance, activities and problems as re- 
lated to the student’s individualized educa- 
tional experiences. 

4- Assume certain responsibilities for the 
evaluation of student progress in coopera- 
tion with guidance counselor and learning 
lab specialist. 

5. Assists the learning center director in 
preparation and/or selection, use, evaluation 
and inventory control of programmed and 
individualized instructional materials used 
in the learning center. 

6. Carry on such activities as to provide for 
his persona] professional growth. 8 

It is to be noted that in the New Jersey ABE 
learning centers of Camden and Newark the 
rooms and room areas in which the instructors 
work are not referred to as “classrooms”. They 
are specifically called “learning areas” and are 
furnished to provide tutorial aid as well as 
small group interaction learning experiences 
for the adult student. 

One can readily see from these descriptions 
of professional staff responsibilities why a 
carefully designed program of training for all 
personnel of a learning center becomes impera- 
tive. In the New Jersey project and in the 
earlier developed pilot mini lab programs pre- 
service training, as well as formal in-service 
training, of all professional personnel became 
a requirement. 

Under a project plan for the New Jersey 
Learning Center project, to become fully opera- 
tive by October 15, 1968, all full-time profes- 
sional personnel were recruited by September 
20. Nearly all of the more than thirty person- 
nel hired for the centers had previous teaching 
experience in traditional ABE programs and 
held teaching certificates. Several of the staff 
had participated in ABE teacher-trainer sum- 
mer institutes. All personnel underwent an in- 
tensive program of preservice training planned 
and developed by the Adult Education Resource 
Centers of Montclair, Newark, and Glassboro 
State Colleges. Each college Adult Education 
Center assumed direction of one or more of the 
preservice training programs. The .ollowing 
outline briefly describes the planned, though 
limited, program. 

Combined staff pre-service training pro- 
grams areas of development: 

1. Sensitivity to the needs and concerns of the 
adult as related to a learning center pro- 
gram. 



2. Orientation to instructional techniques in the 
development of skill area learning experi- 
ences of adults at the learning center, such 
as programmed instruction, individualized 
instruction, small group seminar, supple- 
mental approaches. 

3. Orientation to learning experience materials 
— selection and use of — for the adult at a 
learning center 

4. Orientation to the nature of the learning 
laboratory and the counseling services as 
an important phase of the total learning 
center experience for the adult. 9 

Preservice training schedule 
The combined staff met six times in two 
weeks in the fall of 1968 for five to eight hour 
sessions as follows: 

1. Sensitivity training 

Glassboro State College Adult Education 
Center 

Livingston Cross, Director of Center 

2. Center directors and lab specialists 
White Plains Learning Center 
Elliott Lethbridge, Center Director 
John XaKanes, Lab Specialist 

3. Center staff meeting under the leadership 

of the center director 

At each learning center in Newark and 
Camden 

4. ABE curricular materials — selection and 

use 

Montclair State Adult Education Center 
Dorothy Minkoff, Director at the Newark 
State College Center 

Irene Curry, Curricular Materials Consult- 
ant 

5. EDL “learning 100" orientation and ABE 

teaching techniques 

Montclair State College Adult Education 
Center 

Joe McCarthy, EDL "Learning 100" Train- 
ing Specialist and Adjunct Professor, 
Montclair State College 
Florence Dick, Associate Director, Mont- 
clair State College Adult Education Cen- 
ter Reading Specialist 

6. Counseling and the lab specialist activity 

in a learning center 
Camden Learning Center 
Elliott Lethbridge, Director of White Plains 
John KaKanes, Lab Specialist 
Ann Serrao, Counselor. 10 



In addition to the formalized program of pre- 
service training a program of selected reading 
was carried on by each staff member from ma- 
terials preselected for their particular value in 
terms of the tasks involved at the learning cen- 
ter?. A copy of this list of readings is available 
through the Learning Center Project Office. 

In-service training programs are carried 
on regularly at each learning center, focusing 
upon the specific needs of staff at each center. 
At the conclusion of three months’ operation all 
full-time and part-time professional staff mem- 
bers are involved in a program of self-evalua- 
tion with a particular emphasis on the profes- 
sional responsibilities each is undertaking at 
the learning center. To develop an instrument 
for the self-evaluation of each staff member, a 
series of meetings with the staff members of 
each center led to the creation of the following 
self r sorting questionnaire of professional 
responsibility and performance: 

The primary, as well as ultimate, purpose 
of evaluations is improvement of performance 

1. Define your role{s) at the learning center, 
as you perceive it (them). 

2. Evidences) of the application of knowledge 
with respect to aims and objectives of the 
ABE learning center operation: 

3* Evidences) of “sensitivity” to the charac- 
teristics of the adult learner enrolled in the 
learning center program: 



4. Evidences) of competencies with respect to 
individualization of instruction: e.g., in- 
structional techniques, instructional ma- 
terials selection, awa r eness of individual 
student needs, learner’s response, etc. 

5. Evidence^) of the knowledge, and use, of 
adult oriented instructional materials: 

6. Evidenced) of a cooperative “team" effort 
with respect to assessment of adult student’s 
needs, and the instructional effort related to 
the student’s needs: 

7. Evidenced) of cooperative “team” effort 
with respect to over-all learning center 
program development: 

8. Evidence^) of professional growth: 

9. Your appraisal of the learning center’s 
program development: 

10. Other comments: 

During the period from January 15 to Feb- 
ruary 15, 1969, each staff member noted his 
own self- evaluative assessments. Upon com- 
pletion of the self-evaluation form the staff 
member shared his own evaluation with an 
evaluation of his role made by the learning 
center director. As the areas of professional 
strengths and weaknesses are identified through 
this comparative evaluation and a more forma- 
lized series of bi-monthly seminar sessions, a 
continuous program of inservice training will 
be developed. 



NOTES 



Definitions of positions and delineations of 
job responsibilities were prepared by the 
author to meet New Jersey Department of Edu- 
cation P-Tsonncl Division and New Jersey De- 
partment of Civil Service requirements for 
creating civil service positions and determin- 
ing salary ranges. 

1. New Jersey Department of Education, ABE 
Learning Center Guidelines: Initial Formula - 
lion, September 1968'May 1969 (Camden, New 
Jersey: New Jersey Department of Education, 
Camden ABE learning Center, n.d.), p. 1. 



2. Ibid. 

3. Ibid., p. 5. 

4. Ibid. 

5. Ibid., p. 18. 

6 . Ibid. 

7. Ibid., p. 22. 

8. Ibid. 

9. Ibid., p. 31. 

10. Ibid., pp. 31-33. 
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MICROTEACHING: AN ILLUSTRATION OF PERFORMANCE TEACHING 

Kevin Ryan 



The word relevance is having a heyday. It 
has become a one-word platform for reform and 
reappraisal. For teacher education to be rele- 
vant, its students should be getting the skills, 
attitudes, and directions they need to perform 
well as teachers. In its simplest form the job 
of teacher educators is to accept decent, liber- 
ally educated people and provide them with a 
set of experiences which will make them suc- 
cessful — that is, will be relevant — in their 
new role. The woeful condition of the schools 
today is some indication of success to date. 

Seventy or eighty years ago, when the uni- 
versity captured teacher education, it had a 
great opportunity to analyze the uniqueness of 
teaching and build a training program accord- 
ingly. This is not what happened. Except for 
student teaching, the university has treated the 
professional training of teachers the same way 
it treats general education. It forced teacher 
education intc the prevailing university mode 
of courses, lectures, books, and examinations. 
Over the years it has become evident that teach- 
er education is not working, that teachers can- 
not put the ideas espoused from the lectern 
into classroom practice. The university's re- 
sponse h s not been to re-examine this prob- 
lem as r uch as to move defensively away from 
it. The young teacher is told, “We cannot give 
you practical solutions. We cannot prescribe 
answers. We can only expose you to the great 
organizing principles and theories of education. 
Once these are grappled with, they will inform 
and direct your practice.” As if by some magic, 
a young teacher faced with an abusive student 
will be able to recall a principle from psycho- 
logy to help him at that moment. Universities 
have been able to get away with this because 
future teachers believed that the practical 
knowledge needed to maintain a classroom 
would come during student teaching. I3y and 
large, student teaching is the most valued part 
of teacher training; which is not to say that it 



has been effective. By itself, student teaching 
cannot carry the entire training burden. Al- 
though the methods suggested in this paper are 
equally pertinent for the training of teachers 
for preschool through high education, it should 
be noted that until very recently, the little 
teacher training that has been don: in adult 
basic education has seldom included even stu- 
dent teaching with its inadequacies. 

As the crisis in education deepens, or at 
least becomes more visible, the cry for rele- 
vance from graduate and undergraduate teacher 
trainees becomes more strident. The plea is 
for more practical experiences before and in- 
cluding student teaching or internship. In des- 
pair teacher educators have begun to lose confi- 
dence in the cherished foundations and methods 
courses. The new Zeitgeist is, “Put them in the 
schools earlier so they can learn on the job.” 
The innovative programs are no longer the 
Master of Arts in Teaching (MAT) programs, 
but those which immerse their students imme- 
diately into the “real world” of the schools, in 
para-, sub-, demi-, and semiprofessional roles. 
The intention is to immerse students in the 
activities or functional context of the school 
and then to provide them with applicable theo- 
ries and means of getting answers to the ques- 
tions which arise. This new emphasis on imme- 
diate practice certainly has some strengths, 
particularly when carefully linked to schools 
utilizing a differentiated staffing approach. This 
emphasis also has some deficiencies. It pre- 
sumes that the student of teaching will learn 
what good practice is by coexisting in the 
schools with experienced teachers. In reality, 
what probably happens is that the beginning 
teachers, in their struggle for survival, learn 
to cope with students and the demands of their 
role, acquiring the biases and practices of 
their more experienced colleagues. In other 
words, they imitate what they see and continue 
education as it is. 
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Another difficulty with the instant immer- 
sion-in-the-schools approach is that while 
schools may have many excellent teachers, that 
does not necessarily mean that they have many 
excellent trainers of teachers. One thing that 
can be said about teacher education as it exists 
is that it is filled with people who want to teach 
teachers. Before the practice dimension is ex- 
tended into the classrooms much further, a 
large mass of trainers of teachers must be de- 
veloped who are knowledgeable in what and how 
to teach teachers. If this body of trainers is 
not developed, a cry for practical experiences 
for the sake of relevance may simply reinforce 
much of the irrelevance presently existing in 
American education at all levels. 

Performance Training 

Between the extremes of the traditional tell- 
them-how-to-do-it approach to teacher educa- 
tion and the throw-them-in-the-schools practi- 
cal experience lies the performance approach. 
Performance training is based on the disarm- 
ingly simple idea of first identifying the pro- 
fessional skills and strategies a teacher should 
possess and then building training experiences 
to help people learn to perform those skills. 
Underlying the performance training movement 
is the idea that teaching is behavior. As beha- 
vior it can be categorized into a wide variety 
of activities, such as questioning, explaining, 
telling, testing, evaluating, record keeping, de- 
monstrating, and order-maintaining. If one takes 
the point of view that teaching is basically be- 
havior, then positive steps can be taken to iden- 
tify the important skills and the training proce- 
dures which provide nonteachers with teaching 
skills. 

Over the past few years there have been 
a number of different efforts toward perfor- 
manoe training. Some of these efforts have 
involved the programed learning approach; 
others draw on simulation theory and role 
playing techniques. One such effort to develop 
performance skills is the microteaching ap- 
proach. 

In the ewrly 1960’s teacher trainers at 
Stanford University became dissatisfied with 
the training being provided for teaching candi- 
dates. A great gap was seen to exist between 
forma! teacher education and actual teaching; 
the gap of realistic training. The teaching pro- 
fession, unlike most professions, has not pro- 
vided its practitioners with opportunities for 
safe training, experimentation, or practice. 



Law students have their moot courts; airplane 
pilots their link trainers; medical students 
their cadavers. In those professions the denial 
of such nonacademic training experiences w T ould 
be unthinkable. In teaching, however, all that 
was provided was observation programs and 
student teaching — both of a very hit-or-miss 
quality. Trainers had little control over the 
content of those experiences. Stanford Univer- 
sity teacher trainers, seeing a need for a real- 
istic training situation analogous to those used 
in other professions, spent a three-year period 
developing microteaching in response to this 
need. 

What microteaching has provided is a safe 
but realistic training situation for teachers, 
both preservice and in-service. Microteaching 
is real teaching, but at the same time it is con- 
structed teaching. It is designed so that teach- 
ers can concentrate on the mastery of specific 
teaching skills in a low-risk situation. The 
students do not suffer from it, because it is not 
part of their regular curriculum, The teachers, 
free to experiment with different techniques, 
increase their range of classroom skills. 

Microteaching can be thought of as an 
approach or as a concept. Hopefully, it will not 
reach the status of an orthodoxy. There -ire no 
inviolable rules in microteaching. A micro- 
teaching situation can be described but nr t pre- 
scribed. In a typical microteaching sessio i the 
teacher gives a brief lesson in her subject Her 
performance is recorded on video tape. This 
video tape record is later used in the lesson 
critique. The lesson is a real lesson; a short 
lesson, typically of five minutes. The three or 
four students are real students, although they 
are not part of the teacher’s regular class. 
The focus of the experience, however, for both 
the teacher and her supervisor, is on a specific 
skill. 

When the teacher has finished the lesson, 
she will participate in a lesson critique with 
her supervisor. The subject of the critique will 
be the teacher’s use of the particular skill she 
has been practicing. From what she learns 
from this critique, the teacher will decide upon 
whatever changes she would want to make to 
improve her use of the skill. 

After some time to incorporate these 
changes in her lesson plan, she will re-*each 
the lesson which again will be critiqued. The 
process can be repeated as often as desired 
and altered to fit special circumstances. 

A key advantage to the microteaching ap- 
proach is that it allows for the immediate ap- 
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plication of feedback, that is, the information 
the teacher gains during the critique. It is sug- 
gested that feedback from several sources be 
used. One source is feedback from the super- 
visor who may be anyone qualified to guide the 
teacher in critiquing the lesson. He may or may 
not be known to the teacher. He may be a mem- 
ber of the institution conducting the clinic or be 
employed specifically for microteaching super- 
vision. A second source of feedback is the 
uudio or video tape recording of the teacher’s 
performance. Video tape equipment is not es- 
sential to an effective microteaching clinic, cut 
is a most valuable tool. Its use is recommend- 
ed when and where possible. Video tape assists 
the supervisor in analyzing a performance and 
in communicating his analysis to the teacher. 
Video tape allows the teacher to see herself 
teaching which is valuable in promoting self- 
evaluation and self-improvement. Third, the 
use of feedback from colleagues such as fel- 
low participants in the clinic is suggested. Be- 
sides providing the teacher with additional 
feedback, the colleagues themselves learn by 
observing the session. A fourth source of feed- 
back is the students. Student feedback is poten 
tially quite rich, although it has almost always 
been used in an unproductive way. Research 
has shown that intelligently channelled 
student feedback is highly reliable. Finally, 
the teacher herself is a source of feedback. 
The self-critique is central to the mtcroteach* 
ing approach. The teacher needs to learn how 
to evaluate her own performance. By compar- 
ing her evaluation with those of her supervisor, 
her colleagues, and the students, she will gain 
the perspective necessary for self-evaluation 

These five sources of feedback have a com 
mon quality; they focus on the specific skill be 
ing practiced. The supervisor does not evaluate 
the lesson as a whole; he restricts his critique 
to the specific skill under consideration. The stu- 
dents are not asked, “How did you like the les- 
son? but questions designed to elicit information 
pertinent to the skill being practiced. Microteach- 
ing increases useful feedback, while decreasing 
irrelevant feedback. In addition, since the teache' 
can apply this feedback to his reteach lesson 
shortly after the critique, maximum immediate 
use of it is made. 

In essence, microteaching is a training set- 
ting. To date, teaching skills that stress the teach- 
er’s activity have been chosen for identification 
and training. The skills have been broken down 
into five groups or clusters of skills as follows: 
response repertoire, questioning skills, increasing 
student participation skills, creating student in- 



volvement, and presenting skills. A definition of 
each of these skill clusters follows. 

I. Response Repertoire 

A. Verbal Responses. The teacher attempts 
to broaden his range of verbal respon- 
ses to various situations in order to 
communicate more effectively with 
his students. In practice, the teacher 
reads statements he might make in 
a classroom and gives at least three 
different meanings to each statement. 

B. Nonverbal Responses. The teacher 
considers several nonverbal respon- 
ses, such as facial expressions and 
gestures, and the different feelings 
he wishes to convey. Using combi- 
nations of nonverbal techniques, he 
tries to convey these feelings. Es- 
sentially, acquiring nonverbal re- 
sponses involves exercises in panto- 
mime. (It should be noted that in the 
teaching of undereducated, somew’hat 
nonverbal adults this skill can be of 
great importance). 

C. Verbal and Nonverbal Responses. The 
teacher begins with nonverbal respon- 
ses. He then repeats the oral state- 
ments made in practicing the first 
skill, verbal responses, combining 
them with the appropriate nonverbal 
responses. 

I I. Questioning Skills 

A. Fluency in Asking Questions. The 
teacher tries to ask as many logical 
and relevant questions as possible 
during the brief lesson. Mastery of 
this skill provides a new teaching 
technique for the teacher who tends 
to depend too heavily on the lecture 
method in making his classroom pre- 
sentations. Hi begins to develop a 
dialogue with his students. 

B. Probing Questions. Probing requires 
that teachers ask questions that re- 
quire pupils to go beyond superficial 
first-answer responses. The teacher 
demonstrates probing by; (1) asking 
the pupil for mme information and 
meaning; (2) requiring the pupil to 
justify his response rationally; (3} re- 
focusing the pupil’s or the class’s 
attention on a related issue; (4) prompt- 
ing the student or giving him hints; and 



(5) bringing other students into the dis- 
cussion by getting th*m to respond to 
first student’s answer. 

C. Higher-Order Questions. Higher-order 
questions are defined as questions that 
cannot be answered from memory or 
simple sensory description. They call 
upon the student to draw his own con- 
clusions. A "‘good” higher-order ques- 
tion prompts students to use ideas 
rather than just to remember them. 
Although some teachers intuitively ask 
such questions, far too many overem- 
phasize questions that require only the 
simplest intellectual activity in re- 
sponse. Procedures used with this 
skill have been designed to sensitize 
teachers to the effects on their / slu- 
dents of various kinds of questions. 
It also helps teachers to develop their 
own ways of forming and using higher- 
order questions. 

D. Divergent Questions. These questions 
are usually open and they have no single 
correct answers. They require the stu ; 
dents* to think creatively, to leave the 
comfortable confines of the known anc 
to reach out into the unknown. Fre- 
quently, students are asked to make 
hypotheses and to use their imagina- 
tions in responding to the teacher’s 
inquiries. 

III. Increasing Student Participation Skills 

A. Reinforcement. Reinforcement is an in- 
centive used by the teacher to reward 
students for proper behaviors. The fo- 
cus is on the teacher’s use of positive 
reinforcement to increase student par- 
ticipation in classroom discussions. 

B. Recognizing Attending Behavior. This 
is a skill designed to alert the teacher 
to what is going on in his classroom 
by training him to observe tne cues his 
students present. By observing their 
facial expressions, body postures, and 
how they work or do not work, the 
teacher can tell a great deal about his 
students’ interest level and attention 
span. From these cues the teacher can 
make judgments about whether to con- 
tinue the activity, change it, or use a 
different mode of instruction. Recog- 
nizing attending behavior is a prereq- 



uisite for almost any kind of classroom 
decision. 

C. Silence and nonverbal cues. These tech- 
niques are designed to allow the teacher 
to direct classroom discussions with* 
out talking. Nonverbal communication 
is one of the most neglected means of 
teacher-student interaction, but one of 
most powerful. Student teachers prac- 
tice orchestrating discussions through 
nonverbal cues which give feedback and 
help to elicit student responses. 

D. Cueing. Cueing is designed to give the 
teacher more control over the success 
a student has in making a comment. The 
teachers use of cues can greatly in- 
crease the student’s chances for mak- 
ing a worthwhile contribution to the 
class. 

IV. Creating Student Involvement 

A. Set Induction, Creating a mood in the 

classroom conducive to a certain learn- 
ing experience is the subject of this 
skill training. Set induction involves 
introducing a lesson in an interesting 
way ^nd establishing common frames 
of reivience between students and teach- 
er. The teacher initiates the activity. 

B. Stimulus Variation. The teacher uses 
both verbal and nonverbal teenniques 
to stimulate students. This skill is 
actually a composite of several small 
skills, all of which aid the teacher in 
providing greater variety in his class- 
room teaching. 

C. Closure. Closure is a means by which 
the teacher helps the students to com- 
prehend the organization of the main 
ideas and information presented in the 
lesson. An act of pulling together the 
major points, closure is complemen- 
tary to set induction. It provides a link 
between past and new knowledge, and 
helps the pupil to gain a feeling of 
achievement. 

V, Presentation Skills 

A. Lecturing. Here the teacher practices 
some of the techniques of lecturing. De- 
livery techniques, use of audiovisual 
materials, set induclion, pacing, clo- 
sure, planned repetition, and other 
skills related to lecturing are included. 
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B. Use of Examples . The use of examples 
is basic to good teaching. Examples are 
necessary to clarify, to verify, and to 
substantiate concepts. Both inductive 
and deductive uses of examp^s can be 
effective in teaching. Uses of examples 
are as follows: (1) starting with simple 
examples and progressing to more 
complex ones, (2) starting with exam- 
ples relevant to the students’ experi- 
ence and knowledge; (3) relating the 
examples to the principles or ideas 
being taught; {4) checking to see if the 
objectives of the lesson have been 
achieved by asking students to give 
examples that illustrate the main 
point; and (5) using analogies and 
metaphors to relate the known to the 
unknown. 

C. Planned Repetition. The purpose of this 
skill is to clarify and to reinforce ma- 
jor ideas, key words, principles, and 
concepts in a lecture or discussion. 
The use of planned repetition is a pow- 
erful technique in focusing and high- 
lighting important points and describ- 
ing them from a different point of view. 
Improper use of this skill can cause 
confusion among the students, while 
proper use can direct their attention 
to points the teacher wishes to em- 
phasize. 2 

To most scientists, research in teaching is 
in a primitive stage. To most practitioners, re- 
search in teaching has very little to say. There 
are many reasons for this. In the opinion of the 
writer, one reason is that until recently little 
emphasis was given to the scientific study of 
teaching. Education has been content with folk 
wisdom and windy assertions. The second reason 
is that the teaching act is a very complex one. 
There is no definition of the “good teacher.” 
There is no theory of teaching. We have conflict- 
ng theories of learning, and especially, there is 
i variety of types of learning that interact with 
the complexity of the human condition. Third, 
definitive research on the teaching act is hard 
to do in the typical classroom situation. The 
large number of students in a classroom, the 
length of time devoted to the typical classroom 
session, and the complex nature of the variables 
inherent in any school situation makes the class- 
room an unfavorable setting for precise research. 

Although it involves many of the problems 
mentioned above, performance training simplifies 



the research problem. A particular skill or strat- 
egy is identified as worthwhile. The behaviors that 
make up the success of the skill are identified. 
Then through modeling or some form of instruc- 
tion a trainee attempts to acquire the new skill. 
The level of performance on the skill must be 
made quite clear to the trainee. One of the ad- 
vantages of performance training is that trainees 
can move through 'he curriculum at their own 
speed. The institution's resources can be focused 
on the individuals needing the most help, rather 
than spreading it equally among all. 

O^.ce the trainee has acquired the skills, 
there are a number of questions still to be an- 
swered. How does the skill contribute to the 
learning of students? What is the effect of ac- 
quiring one skill, such as reinforcement tech- 
niques, on another skill, such as explaining 
behavior? Do the skills inhibit some of the na- 
tural teaching tendencies of the trainee? How- 
much training is necessary for the skill to have 
transfer value beyond initial teaching encount- 
ers? What are the most basic skills which 
teachers should learn? 

One of the major advantages of the per- 
formance training approach to teacher education 
is that it places the entire activity into a re- 
searchable model. It forces the researcher or 
trainer to be more precise about the most im- 
portant question: What is the teacher education 
program trying to accomplish? The need for 
thinking through the sequence of training and the 
choice of methodology for the different objectives 
necessitate a very careful and systematic formu- 
lation of goals. In. other w-ords, a rigorous de- 
cision must be made about what trainees are to 
be able to do at the end of training. It would 
seem only logical to base the decisions on what 
teacher behaviors, strategies, and skills bring 
about the most desirable changes in students. A 
fruitful source of direction for these decisions 
is the research. Within and across the teaching 
disciplines certain methodologies, approaches, 
and materials have been found through-research 
to be effective. 

The second source of a program’s goals 
should be the collective wisdom of the profes- 
sion. From this storehouse of untested, and in 
many cases untestable, hypotheses about good 
teaching, the most promising can be extracted 
as objectives. For example, suppose it is de- 
cided that teachers should be able to teacb in- 
ductively and also to know- (he most appropriate 
situations in which to employ this type of teach- 
ing. It happens there is little research in this 
area. Or it may be felt that with slow learners 



the teacher should vary activities more fre- 
quently than with other students. Despite the 
fact that one is on the slippery ground of intui- 
tion here, benefits can accrue. First of all, 
by realizing which aims are based on research 
findings and which on tradition or intuition, 
more attention may be paid to the value of the 
goals. In this manner, shibboleths and untested 
truths may be sorted out. Also, the very act of 
identifying which objectives have been research- 
ed will focus the professionals’ attention on the 
most promising hypotheses and in this manner, 
hopefully, they will be able to nibble away sys- 
tematically at the unknown. 

The results of program goal setting should 
be a list of skills the teacher should perform, 
}r a behavioral description of the good ieacher. 
Such a list should include the specific levels of 
performance on such activities as explaining, 
lecturing, directing various types of discussions, 
or questioning behaviors. Further, the list should 
include skills and activities unique to a particular 



discipline. To keep from developing a static 
curriculum in teacher education, this list of 
goals should have built-in change mechanisms 
to meet new demands for teaching skills in the 
classroom. 

This paper has argued for a better planned, 
more Systematic approach to the education of 
all teachers. It has argued that professional 
training should deal with the special ways of 
thinking and acting that lead to successful per- 
formance. If the purpose of teacher education is 
to develop skilled practitioners, then the pro- 
fessional curriculum should be built specifically 
to accomplish this. Each element in a program 
must have proven relevance to the overall ob- 
jectives. Teacher educators should start by 
taking seriously themselves what they expect 
from their trainees, that is, trainers also should 
work out their objectives in behavioral terms, 
test themselves to make sure that they carry out 
those objectives, and test their students to see 
if they have been achieved. 



NOTES 



1. Dwight Allen and Kevin Ryan, Microteach * 
ing (Reading, Mass.: Addison-Wesley, 1967). 

2. Taken from An In troduct ion to Microteaching, 
a film produced by General Learning Corporation, 
New York, 1969. 



3. Kevin Ryan, “A Performance Model for 
Teacher Education,” mimeographed (Chicago: 
University of Chicago, Graduate School of Edu- 
cation, 1969. 
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THE VIDEO TAPE RECORDER IN TEACHER TRAINING RESEARCH 



Herbert L. Nichols 



In June, 1962, a contract was executed be- 
tween the Agency for International Development 
and English Language Services (ELS) in which 
ELS agreed to engage in an operations research 
program to develop within three years a com- 
plete autoinstructional progiam for preparing 
teachers of English as a second language. This 
program was to be designed for overseas use 
with indigenous trainees with minimal speaking 
capabilities in English. 

The schedule of piugram activities was 
divided into four phases. Phase one was the 
data collection phase concerned with elucidating 
the stimulus-response blueprint of teacher be- 
havior at the master skill level. The primary 
instrument used to collect data was the video 
tape recorder. Phase two was the theoretical 
analysis of the data collected in phase one; 
phase three, the preparation of training mate- 
rials and devices based on the prescription de- 
rived from phase two; and phase four, the field 
testing and validation of the training system 
designed The activities to be discussed in this 
paper are those of phase one. The discussion 
will be additionally limited to a qualitative ac- 
counting. 

The purpose of this report is to coordinate 
suggestions offered by Thomas F. Gilbert, a 
behavioral scientist, with video tape viewing 
and reviewing procedures, and to explain how 
the principles of mathetics may be applied to 
isolating and describing the step-by-step teach- 
ing techniques used by the teacher throughout 
each course. 

The project w’as called the Teacher Training 
Research Project (TTRP). After two years of 
operation the project was known as the Teacher 
Education Program (TEP). The staffing require- 
ments of the project brought together persons 
of diverse disciplines: a linguist, a psycholo- 
gist, a sociologist, a cultural anthropologist, 
language teachers, teacher trainers, a psycho- 



linguist, and television engineers and technb 
cians. Additional outside consultants were made 
available to the project as needed. 

Phase one started with the readying of the 
technical crew and equipment to begin taping 
eight hours of regular classroom activity in 
English as a second language. This video tap- 
ing activity had been planned to continue for 
one year, but after about three weeks of taping 
a stop order was issued by the project director, 
and a more rigorous orientation session was 
begun for the technicians and staff led by Dr. 
Gilbert. Following the single orientation ses- 
sion, it was discovered that the technical crew 
was less efficient than they had been in the be- 
ginning. It was then decided that much more 
than a single orientation session was necessary 
for the staff as w’ell as the technical crew. 

Television engineers and technicians, fami- 
liar as they were with television equipment, 
were not prepared to extract via their television 
cameras the behavioral data required to satisfy 
the objectives of this first phase, although very 
muJj at home when photographing a structured 
scene at a studio or even the remote field pick- 
up in the man on the street show’. (Consider the 
time worn cliche, ff I saw it on television or in 
the movies, but it was not like the book.”) In 
other w’ords, to document scientifically the 
master skill level of teacher behavior, artistic 
license could not be given in any quarter. The 
video tape on playback had to report faithfully 
W'hat had happened in the classroom, including 
both the verbal and nonverbal activities. To 
develop fidelity in reproducing classroom be- 
havior, series of seminars were developed in- 
volving the total research team over a period 
of about five weeks. The seminars were divided 
roughly into four parts, of which the first three 
will be amplified in this paper: (1) a description 
and explanation of standard effort ; (2) the teach- 
ing of pertinent mathetics shorthand symbols 



for recording data from video tapes; (3) the 
application of the terminology and concepts of 
mathetics to video tape viewing and reviewing 
procedures; and (4) the need? and techniques 
for indexing, storing, and retrieving this data 
from IBM cards. 

Standard Effort 

Basic to the development of teacher training 
techniques and materials is the description of 
teaching behavior. The English Language Ser- 
vices Language Center developed video tapes 
of the teaching of English as a second language 
for the purpose of describing teaching behavior. 
To accomplish this, teacher-student behavior, 
that is, stimuli and responses, were analyzed 
in terms of standard efforts. The ideal stand- 
ard effort (SE) is what the teacher does (S - 
master skill stimulus) to elicit a correct be- 
havior from the student (R - master skill re- 
sponse). More specifically, the teacher must: 
(1) get the student to observe (S^) the master 
skill stimulus (SD); and (2) get the student to 
make the response (R), while observing the mas- 
ter ikill stimulus (SD). Then the student must: 
(3) observe the outcome of mastery (R); and (4) 
this outcome must be reinforcing (S). 

Since at this stage of research ELS is not 
in a position to state exactly what the ideal 
standard efforts are, they can be described 
only on the basis of what is observed as having 
occurred in actual classioom situations, which 
may or may not be ideal standard efforts. How- 
ever, since it cannot be definitively stated that 
the observed standard efforts are ideal, they 
will be considered as approximations of ideal 
standard efforts (SE')- 

Mathetics Shorthand Symbols 

The folio-wing is an example of a possible 
ideal standard effort based on actual video tape 
observations, to illustrate the application of 
the concept of standard effort to research on 
teaching. 

50 Teacher writes sentence on blackboard. 

Teacher points to sentence and says, 
“Look at this.” 

SC Teacher says, 'This will be a pronunci- 
ation drill.” 

RO All students give their at\entiun to sen- 
tence on blackboard, and nod. 

5 1 Teacher says, “Repeat this sentence after 

„ _ it 

me. 

SP Teacher reads sentence aloud. 



R Students repeat sentence after teacher. 

S Students hear themselves uttering sen- 
tence, and are reinforced; students are 
additionally reinforced by teacher’s com- 
ment, “Good.” 

The teacher must establish a fixed order ot 
mastery, a behavior change. To do this, the 
teacher substitutes prompting (S^) for instruct- 
ing (Si). 

Teacher repeats sentence and exagger- 
ates pronunciation. 

R Students repeat sentence with exagger- 
ated pronunciation. 

S Students are reinforced by hearing their 
own utterances conforming to the teach- 
er’s exaggerated pronunciation. 

In accordance with the suggestions made by 
Gilbert, descriptions of teaching behavior in- 
clude not only standard efforts (SE) which are 
considered efficacious, but also departs from 
good standard efforts (SE). He outlined the 
following types of departures as applicable to 
the individual stimuli comprising standard ef- 
forts: (1) no attempts made, (2) aborted attempts 
made, (3) erroneous attempts made, or (4) exces- 
sive attempts made. 

It goes without saying that the standard ef- 
fort as defined in this paper does not take into 
consideration all of the components of a class- 
room situation. First, however, observers must 
become proficient in isolating and describing 
the basic teaching-learning, teacher-student, 
interaction. Once this proficiency has been 
achieved, the observers can then consider nu- 
ances of behavior having a direct bearing on 
these basic interactions. Categories of the 
teaching-learning situation to be considered 
after this initial proficiency is developed in- 
clude: (1) motivation; (2) competition; and (3) 
special strategies, including: (a) chaining, (b) 
discrimination and (c) generalization. Present 
plans are to describe each of these refinements 
of behavior according to procedures similar to 
those outlined for the description of standard 
efforts, including both approximations of the 
ideal and departures from the ideal. 

The use of mathetics shorthand and the 
scheme of defining idea) teaching behavior and 
possible departures from the ideal served as 
the master blueprint for ELS’s behavioral ex- 
tractive system for professional staff as well 
as for the television technical crew. The s f and- 
ard effort model in some ways resembles many 
of the paradigms describing electronic systems, 
and technical personnel are much at home with 



system? analysis. The concentration of ESL 
teams on camera focus could be more effec- 
tively directed because of the greater under- 
standing of communications behavior analysis 
in the classroom. 1 

ELS began to relate this classroom activity 
as a series of events or stimuli-responses (SR). 
Each SR was identified as a link in the chain of 
total events each class hour. Briefing instruc- 
tions finally were able to be taken from the 
classroom teacher on what her objectives were 
session to session. The video tape recording 
lengths were sixty-five minutes, but total re- 
cording time was limited to fifty minutes unless 
circumstances dictated otherwise. Camera tech- 
nicians became very skilled at identifying and 
recording data pertinent to the prestated objec- 
tives for the session. This activity continued at 
a rate of thirty hours each week for approxi- 
mately one year. 

The opportunity to observe a teacher of one 
culture interacting with learners of another cul- 
ture presented a new communications’ facet to 
the eyes and ears of the cameraman. The sig- 
nificance of body kinesics in cross-cultural 
communications became obvious to the ESL 
staff as they observed the American teacher in- 
teracting with the East African, Arab, Korean, 
and northern European learner. 2 There were 
dramatic differences in the closeness or dis- 
tance maintained by the teacher as she was in 
communication on a one-to-one basis. 3 Stiffness 
and forma; limits of gestural expression were 
observed as used by the Austrian learner to 
the teacher, as well as what was considered by 



the teacher to be an overstepping of closeness 
for conversation by the Arab student. Also, the 
staff was able to see student-to-student and 
teacher-to-student relationships in the hetero- 
cultural situation, such as “boy meets girl/’ 
“the teacher es no sympatico,” or “a woman 
is not a good teacher.’ 1 The capturing of this 
verbal and nonverbal behavior or video tape 
proved to be a most economic system for gath- 
ering research data. The use of this media was 
immediately applied to other language teaching 
and learning activities at ESL facilities. Many 
of the observation and recording skills learned 
in this research effort can be directly applied 
to the problems of designing communications 
training programs for teachers of speakers of 
nonstandard forms of English. 

In conclusion, English Language Services 
has refined and demonstrated the use of the 
video tape recorder for data gathering in re- 
search on teaching. ELS found that technical 
television crews and professional staffs need 
joint training in the behavioral sciences in 
order to obtain a true reproduction of class- 
room behavior and to be able to analyze or de- 
fine that behavior. The goal of the research was 
to define ideal teaching behavior in the teaching 
of English as a second language and departures 
from the ideal, using the shorthand of mathetics. 
Although the development of skill in defining 
classroom behavior must start with the simple 
determination of verbal interaction based upon 
the teacher’s stated objectives, many uses of 
the video tape recorder were seen in research 
on more subtle, nonverbal interactions. 



NOTES 



1. The system motivated several of the tech- 
nicians to gain further knowledge in the field of 
educational technology by enrolling in graduate 
level courses. 

2. Charles E. Osgood and Thomas A. Sebeok, 
eds. Psycholinguistics: A Survey of Theory and 

Research Problems with a Survey of Psycho - 
linguistic Research, ] 951- 1964, by A. Richard 



Dicbold and the Psycholinguist by George A. 
Miller , Indiana University Studies in the His- 
tory and Theory of Linguistics (Bloomington: 
1965). 

3. For a discussion of the use of space by dif- 
ferent cultures, or proxemies, see Edward T. 
Hall, The Hidden Dimension (New York: Double- 
day, 1966). 
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SYRACUSE UNIVERSITY ADULT DEVELOPMENT STUDY: 
A PROGRESS REPORT 

Rolf H. Monge and Eric F. Gardner 



The purpose of this chapter is to review a 
relatively long-term research project in pro- 
gress at Syracuse University. A brief history 
of the beginnings of the project will be followed 
by a discussion of its purposes and its present 
status. This paper will conclude with a brief 
discussion of the plans for the project. 

HISTORY 

The project, a five-year program of research 
funded by the U. S. Office of Education, is for- 
mally entitled ‘ A Program of Research in Adult 
Age Differences in Cognitive Performance and 
Learning: Backgrounds for Adult Education and 
Vocational Retaining.” For easy identification 
this project is titled as the ‘'Syracuse Univer- 
sity Adult Development Study.” The project was 
started in mid-1%6 by the late Raymond G. 
Kuhlen and by Eric F. Gardner, and is presently 
directed by the authors. 

The first two years of the pr -gram were 
devoted in a large measure to an extensive re- 
view of literature, designing and building equip- 
ment, developing data collection instruments 
designing and conducting pilot work for experi- 
mental studies, and developing a pool of adult 
subjects. 1 In short, the first two years were 
largely devoted to “tooling up.” For the most 
part this phase has been completed, and the 
major part of the program is now under way. 

It would be inappropriate to discuss the his- 
tory of this program without a mention of the 
contribution made by Raymond G. Kuhlen who 
was, with Dr. Gardner, the cofounder. Dr. Kuh- 
len was a noted developmental psychologist, 
whose major interests were the psychology of 
adolescent development and the psychology of 
maturity and old age. In the field of gerontology 
he Vi probably best remembered for his con- 
tributions to the study of age trends in motiva- 
tion and adjustment. During the last years of 
his life his attention was focused in irticular 
on motivation and on personality variables that 
might differentially influence learning during 
young adulthood, middle age, and the later 



years of life. Dr. Kuhlen’s contribution to this 
project was profound, and his loss deeply felt. 
Much of the descriptive material that follows 
has been adopted or paraphrased from material 
that Dr. Kuhlen participated in writing. 

PURPOSES OF THE 
ADULT DEVELOPMENT STUDY 

This project grew out of the recognition of 
the social importance of programs aimed at the 
retaining and vocational rehabilitation of work- 
ers at all levels and of all ages. It was given 
impetus by concern over the lack of scientific 
information about the role of personal variables 
in complex human learning at different adult 
ages. There can be little doubt that the degree 
to which the productive abilities of adults of 
different ages can be utilised in various types 
of work situations, and the degree to which 
adults can be effectively and efficiently retrained 
depends in large measure upon an understanding 
of their intellectual resources and learning 
ability. 

A good deal is already known. Botwinick has 
recently published an excellent critical and in- 
terpretive review of research on adult cognitive 
processes and is, himself, a distinguished con- 
tributor to this area. 2 A very substantial body 
of research dt.ta on adult learning has been ac- 
cumulated since the early reports of Thorndike 
thirty to forty years ago. 3 However, most re- 
search has served primarily to describe age 
differences in learning and performance as evi- 
denced in laboratory types of tasks. 4 Little re- 
search has been done on the more meaningful 
types of verbal learning, nor has much been 
directed toward an analysis of the types of vari- 
ables, particularly personal variables, that 
m : ght differentially influence learning at differ- 
ent times in adult life. While there have been 
many studies of age differences in performance 
on intelligence tests, such data are relatively 
restricted in scope, especially with respect to 
the sampling of abilities with items appropri- 
ate to older adult groups. Little is known re- 



garding the range of educational knowledge and 
skills (reading comprehension, arithmetic skills, 
general knowledge) that people of different ages 
bring to learning tasks. Nor is much known re- 
garding adult age differences in motivation to 
achieve or the degree to which adults experi- 
ence apprehension and anxiety in situations re- 
quiring new learning. 

One purpose of the Syracuse program of re- 
search is to determine age differences in cogni- 
tive abilities with special reference to items 
selected as suitable for adults of different ages, 
to survey the educational backgrounds and skills 
that older and younger adults bring to learning 
situations, and to study age differences in per- 
sonality characteristics likely to influence the 
individual's learning. A second main purpose 
of the research is to investigate experimentally 
the interaction of the variables mentioned above 
with the age of the learner in determining learn- 
ing and performance. 

Cognitive Abilities, 

Educational Background, 
and Learning Orientation 

The first of the two aspects of this research 
program involves a determination of adult age 
differences in a variety of abilities and per- 
sonal characteristics of presumed importance 
in learning at different adult ages. The follow- 
ing description relates to studies of adult age 
differences in: (1) congitive abilities, (2) educa- 
tional background, and (3) learning orientation. 

Adult Age Differences in 
Cognitive Functioning 

It is obvious that the ability of adults of dif- 
ferent ages to profit from educational, training, 
or retraining programs will depend in part on 
the types and levels of abilities they bring to 
those tasks. Yet, except possibly for Wechsleris 
studies with an intelligence scale designed for 
use with adults and a study by Demming and 
Pressey, there has been no systematic nor ex- 
tensive effort to explore adult age differences 
in cognitive abilities as such abilities are re- 
vealed on a wide range of types of individual 
items, or on items appropriate for adults of 
different ages. 5 Mainly, explorations of intel- 
lectual differences during the adult life span 
have been accomplished by means of te^ts that 
have been developed for r.nd standardized on 
young adult populations, such as college stu- 
dents or army selectees. And these studies 
have focused upon age differences in subtest 
or total test scores, with little attention paid 
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to age trends on individual items. The resulting 
data have serious limitations for an understand- 
ing of adult abilities. In the first place, it is 
not improbable that tests designed for young 
adults will prove to be biased against older 
adults; the observed decrements in test per- 
formance noted with increasing adult age may 
simply reflect the structure of the test. In the 
second place, the subtests employed, for ex- 
ample, vocubulary and general information, are 
relatively short and homogeneous. 

In light of these probable age biases on tests, 
it is likely that some of the seemingly well- 
established generalizations regarding mental 
functioning, such as those relating to the stabi- 
lity of the functions measured by vocabulary 
and information, reflect an oversimplification 
of the problem. In contrast to stability over age, 
it is reasonable to expect that rather important 
age trends w r ould be found to occur if a wider 
variety of items were sampled and varying 
levels of scoring criteria employed. One would 
anticipate, for example, that vocabulary rele- 
vant to various interest patterns would show 
gains or losses as interest in those areas waxed 
or waned. It might further be anticipated that in 
a technologically dynamic culture, in contrast 
to a static culture, new concepts, that is, new 
w r ords, and new information w T ould be generated 
at a relatively rapid rate and would be trans- 
mitted with greatest force to the younger people 
in a society. Under these circumstances older 
people would presumably be at a disadvantage, 
when compared with younger people, in their 
knowledge of newer concepts, although they may 
equal their juniors or even have an advantage 
over them on .information items relating to the 
more static elements of the culture. 

One would be led to expect that much is to 
be learned about adult intellectual functioning 
through the construction of a wide variety of 
different types of items, and especially through 
the development of items that are differentially 
appropriate for the various age bands of the 
adult population. One major phase of this re- 
search program involves the development of 
such items and the exploration of adult abilities 
by these means. 

Thus far, twenty tests have been devel- 
oped specifically aimed at discerning differ- 
ential age trends among adults. About a dozen 
of these are cast essentially in the form of 
specialized vocabulary tests, that is, tests of 
knowledge of terminology in such areas as 
modes of transportation current at various 
times in the past seventy-five years; finan- 
cial matters, including stocks and bonds, es- 
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tate management, wills, and installment buy- 
ing; diseases and other medical matters 
peculiar to various adult ages and matters 
related to life termination; fashions in cloth- 
ing in this century; arts and literature; and 
hobbies and sports popular among different 
age groups. Two particularly interesting de- 
velopments have been vocabulary tests of 
slang current among different generations and 
of words coined or deemed acceptable by lexi- 
cographers at different times in recent his- 
tory. These tests are of particular interest 
because of the degree of objectivity that it 
has been possible to achieve in constructing 
them through the sampling of contents of 
slang dictionaries and unabridged diction- 
aries. The major effort has been to develop 
tests that contain items designed to give one 
generation a particular advantage over anoth- 
er, either by virtue of members of the gener- 
ation having lived in the culture at the time 
when now-obsolete or extinct modes of trans- 
portation, entertainment, language, and so on, 
were current, or by virtue of the existence of 
age-related experiences, for example, di- 
sease, or wills and estate management as op- 
posed to installment buying. As will be noted 
later, several of the vocabulary tests have 
reached an advanced state of development and 
are currently being administered to a large 
number of individuals. Others are being de- 
veloped, and some are being rewritten as the 
result of findings from preliminary adminis- 
trations. 

Several additional sets of items in various 
formats are also being developed, all having 
undergone at least one preliminary adminis- 
tration. Some of these items are designed to 
sample interest or experience domains such 
as cooking and recipe manipulation, card 
games, and understanding time tables and 
road maps. Others are designed to determine 
age differences in test-taking behavior, such 
as guessing strategies, distraction by irrele- 
vant information, response omission, and abi- 
lity to follow directions. 

While a major aspect of the analysis of the 
data consists of the establishment of age 
trends and sex differences for individual 
items and significant groups of items, atten- 
tion is also being directed to the possibility 
that ability as so assessed may have differ- 
ential validity at different ages. Exploration of 
this issue is being accomplished in two ways: 
(1) through the determination of age differ- 
ences in the correlation of the individual 
items with some learning criterion, such as 
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performance on the laboratory tasks to be 
described later in this paper. 

Adult Age Differences 
in Educational Background 

The ease with which adults of different ages 
can deal effectively with demands made upon 
them in training or retraining programs will 
also depend to no small degree upon the 
amount of relevant knowledge and learning 
skills, such as reading, that they bring to 
such tasks. Smce older adults tend to have 
less formal schooling than younger adults and 
are more remote in time from that schooling, 
it is reasonable to expect that they would 
bring less in the way of background to the 
learning tasks they face. However, it is pos- 
sible that social and occupational demands 
made upon at least some adults will result in 
informal learning to a degree that more than 
compensates for expected deficiencies. Thus, 
the actual level of background knowledge and 
educational skills that adults possess can be 
ascertained only by a direct check. One phase 
of the Syracuse program consists of a survey 
of the educational level of adults of various 
ages. An appropriate instrument for such a 
survey is the Adult Basic Learning Examina- 
tion (ABLE). 6 The ABLE contains subscales 
relating to such knowledge and skill areas as 
arithmetic computation and problem solving, 
reading comprehension, general vocabulary, 
and spelling. While there is a degree of over- 
lap between certain of the items included in 
this instrument and items involved in the tests 
outlined above, the distinction between the two 
is the degree to which such skills and know- 
ledge are explicitly taught in schools. The 
types of items included in the survey using 
the ABLE consist of formally-taught school 
materials. 

While there have been some scattered stud- 
ies of adult age differences in educational 
background, no study has systematically and 
extensively explored this matter. Most con- 
clusions regarding such matters are based on 
inferences from the administration of stand- 
ard intelligence tests. 

Adult Age Differences 
in Learning Orientation 

The extent to which adults of different ages 
are positively oriented toward the seeking of 
new educational experiences (whether these be 
voluntarily selected courses in continuing edu- 
cation or retraining programs necessitated by 
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change or work), or the extent to which they 
react negatively to such learning opportunities 
because of uncertainty or apprehension may, 
in a practical sense, be of even greater im- 
portance than the abilities or the backgrounds 
they bring to such tasks. They may, in fact, 
avoid uncertain or anxiety-producing situa- 
tions. Even when involved in a learning pro- 
gram, the level of an individual’s performance 
likely will be determined significantly by the 
extent to which he is achievement oriented or 
is threatened by the situation in which he 
finds himself. 

It has been rather clearly established, for 
example, that in complex types of learning, 
anxiety tends to have a negative effect, reduc- 
ing performance. Among other reasons, this 
may come about because the anxious or threat- 
ened person experiences some confusion be- 
tween competing responses, is unable to at- 
tend to the taskj or tends to make up his mind 
too quickly with regard to how he should pro- 
ceed. In view of the theoretical as well as the 
practical importance of such personal varia- 
bles in the learning of adults of different ages, 
a third element has been included in the sur- 
vey of adult age differences, namely what has 
here been called “learning orientation.” An 
attempt is being made to determine whether 
middle age and old age bring positive or nega- 
tive changes in learning orientations. 

The relevance of different types of learn- 
ing orientation variable to adult learning can 
be commented upon more economically in con- 
nection with the procedures being utilized or 
planned for measuring these various charac- 
teristics. It is necessary in this phase of the 
study to obtain information regarding four 
types of characteristics. (1) motivation for 
learning and achievement, (2) learning appre- 
hension or anxiety, (3) personal rigidity, and 
(4) life-style or learning sets. Each of these 
characteristics will be discussed briefly in 
turn. 

Motivation for learning refers to what is 
commonly called achievement motivation — 
tne desire to achieve and accomplish either in 
competition with one’s self, with an absolute 
standard of competence, or with others. In a 
sense, the Syracuse studies are concerned 
with the likelihood that adults of different 
ages will seriously apply themselves to learn- 
ing tasks. The measure being employed in 
this study is being patterned after existing 
scales designed to measure achievement 
motivation. 

The measures of learning apprehension re- 
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late to the degree of apprehension, uneasi- 
ness, or nervousness generated by learning 
situations or various cognitive task situations 
that an individual faces. Several types of 
measures are being tried. One measure re- 
lates to what has been called “test anxiety,” 
and another commonly is referred to as 
“manifest” anxiety. The test anxiety scale is 
being developed in the pattern of existing 
scales, though phrased with due regard to the 
adult age of tM sample studied and the types 
of situations adults face. The scale of mani- 
fest anxiety is also being adapted from exist- 
ing scales. The primary requirement for the 
measure of learning apprehension is that the 
scales be brief though reliable, that the sub- 
scales sample anxiety generated in different 
situations, and that the overall scale be ac- 
ceptable to adults of varying ages. One im- 
portant assumption in theories attributing 
causal significance to anxiety in producing 
age-related variance in performance and in 
other aspects of personality is that anxiety 
becomes more general and less situational 
with increasing age. This assumption is being 
tested in the present research. 

A measure of rigidity, conceptualized as a 
need for structure, is included among the 
scales being employed and planned in this 
phase of the program because of the theoret- 
ical importance of rigidity in learning. Evi- 
dence seems to suggest that people do, indeed, 
become more rigid with increasing adult age 
(although the data are not entirely consistent), 
and that the rigid person prefers certain 
types of learning tasks (school subject matter, 
for example) and learns more effectively with 
relatively structured teaching procedures. 
However, the rigid person may also pose for 
himself certain ha u iicaps to learning by 
reaching premature decisions regarding solu- 
tions to problems or by incorporating ele- 
ments that are in fact irrelevant into his per- 
ception of the problem or its solution. A short 
form of the dogmatism scale used by Rokeach 
in research on rigidity as related to learning, 
problem solving, and other behaviors has re- 
cently become available and is being used both 
in its present form and with further develop- 
ment. 7 

A final measure of personal characteristics 
planned for use in the adult development study 
relates to w’hat might be called “style of life.” 
It is probable that the individual who has de- 
voted his time to recreations of a nonintellec- 
tual sort will be less competent in learning 
tasks than an individual who has a history of 
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active participation in activities involving ini- 
tiative, responsibility, and new learning. Style 
of life refers essentially to what Harlow call- 
ed learning sets. fl It is not unlikely that a part 
of the threat that seems to be posed for older 
adults by new learning situations stems from 
the fact that they are aware that they have not 
participated in new learning for some years 
and therefore do not have the appropriate ori- 
entations or sets for such learning. Quite 
aside from the extent to which threat is in- 
volved, a lack of experience in learning may 
prove a serious handicap to the older learner. 
Accordingly, it seems desirable to attempt to 
measure life-style in relation to learning and 
to determine the degree to which adults of dif- 
ferent ages are characterized by a lack of 
learning experience. 

Two instruments have been developed by 
Ingham and by Litchfield, consisting primarily 
of surveys of the types of activities in which 
people have recently engaged, which have been 
selected carefully according to the degree to 
which they involve initiative and new learn- 
ing. 9 In a sense, what is being measured by 
these scales is not only the character of pre- 
sent experience, but the degree of positive af- 
fect associated with living in general, espe- 
cially as related to new learning experiences. 

EXPERIMENTAL STUDIES 

The second major aspect of the program 
of research outlined in this paper relates to 
the actual performance of individuals of dif- 
ferent ages in learning tasks and the inter- 
action of various personal characteristics 
with age in the performance of those tasks. 
Several major hypotheses which give direction 
to this series of studies will be stated in a 
general way. 

Major Hypotheses 

The first major hypothesis being investi- 
gated is that a measurable portion of the dec- 
rement in learning performance usually found 
with increased adult age may be attributed to 
the greater susceptibility of older adults to 
psychological stress. The ways in which anx- 
iety may influence learning have been sug- 
gested above. Available evidence indicates 
that older adults tend to exhibit more anxiety 
symptoms than do young adults, especially 
under stressful conditions, suggesting one 
possible explanation for learning decrements 
with increasing adult age. 10 

A fairly extensive experiment is underway 



to assess the effects of social stress on adults 
ranging in age from the early twenties through 
the seventies. Subjects are drawn from the 
memberships of several cooperating social, 
cultural, and religious organizations in the 
Syracuse area. The treasury of each organi- 
zation is enriched in proportion to the number 
of its members and their spouses that volun- 
teer to participate. Subjects, segregated by 
sex, are randomly assigned in order of ap- 
pearance to one of two conditions. The control 
group consists of three subjects seated side- 
by-side in the same room, but visually inac- 
cessible to each other, each working at his 
own pace through eighteen multiple-choice 
items presented one by one on individual pro- 
jection screens. There are six verbal reason- 
ing items, six perceptual reasoning items, 
and six arithmetic problems presented in 
mixed order. Each item is presented automa- 
tically for a maximum of sixty to sixty-five 
seconds, which is, for the vast majority of 
people, more than ample time. Thus, little or 
no stress is engendered by time pressure. 
Subjects indicate their choice of the alterna- 
tive answers by push button and are given 
immediate knowledge of the results on each 
item by signal lights. The experimental group 
performs the same task, but the subjects can 
see each other and can see one another’s sig- 
nal lights, so they know whether the multiple- 
choice selected by one of them was right or 
wrong. As in the control group each subject 
proceeds at his own pace. It is quite difficult 
for subjects to read the item presented on 
other than their own screen, so there is little 
chance for contamination. Furthermore, the 
middle subject is in reality a fake subject or 
stooge — one of two members of our staff of 
the same sex as the subjects. The stooge is 
instructed to stay two to three items ahead of 
the faster of the two subjects. The stooge’s 
console is rigged to indicate on the signal 
lights that 16 of 'the 18 responses made are 
correct, regardless of the choice buttons 
pushed. The stooge also makes “helpful re- 
marks” along the way, such as “Gee, these 
are easy,” or “Hey, there’s a trick to solv- 
ing these.” These remarks are carefully 
scripted and standardized so that all subjects 
get the benefit of the same performance. At 
no time, incidentally, does the stooge direct 
comment individually at either subject, so 
there is nothing personal in his or her re- 
marks. The basic idea, of course, is to pro- 
vide the subjects in the experimental group 
with a social stress situation that is not too 



far different from the type of experience that 
might be encountered in an adult education 
class when people disparate in ability, experi- 
ence, and age are gathered together. 

The dependent variables in this study of 
social stress are the number of correct re- 
sponses, the latency of response, the degree 
of confidence in response (which is also indi- 
cated by the subject with push buttons), and 
the deviation in heart rate, from preexperi- 
mental base-line data, which is assumed to be 
a measure related to the degree of stress ex- 
perienced. Subjects also complete pretest 
and post-test anxiety questionnaires. 

Although the social stress experiment is 
still in progress, the very small part of the 
data considered to date seems to indicate that 
male subjects aged in the forties and fifties 
make more correct responses than males in 
the twenties and thirties, but that the older 
male subjects in the stress condition are 
more affected relative to their controls than 
are flu- younger men. It must be emphasized 
that this is only a preliminary impression; 
however, if this finding holds up through the 
end of the experiment, it could be quite signi- 
ficant. Although the stress condition was fully 
expected to be more deleterious to the older 
subjects, that the level of performance would 
be generally higher among the older people 
w’as not expected. 

The second general hypothesis relates to 
the role of attitudes in learning. It has been 
shown in previous research that individuals 
who hold unfavorable attitudes have difficulty 
in both learning and remembering verbal ma 
terial related to those attitudes. This is a 
somewhat controversial area of research, 
with recent studies suggesting an interaction 
between emotional and cognitive variables in 
determining the poorer performance of those 
with attitudes unfavorable to the content of 
material to be learned. In view' of the greater 
rigidity and dogmatism of the older adult, it 
may be predicted that the emotional element 
will outweigh the cognitive element in this in- 
teraction to a greater extent for him than for 
the younger individual. In other words, it is 
hypothesized that the degree to w r hich an older 
adult can learn controversial material is in- 
fluenced by his attitudes to a greater degree 
than is true for the younger adult. This study 
is in the pilot phase. 

The third major hypothesis involves the 
relation of learning sets to age losses in 
learning performance . 11 The learning set 
hypothesis asserts that, for one reason or 



another, older adults do not know how to lean 
as well as younger people. In his classi 
paper, Harlow defined learning set as “learr 
ing how to learn a kind of problem, or tram 
fer from problem to problem .” 12 Learnin, 
set refers to a nonspecific transfer of learn 
ing -- the transfer of the knowledge of th< 
tools and techniques of learning rather thar 
the transfer of a specific subject matter. I: 
the context of aging it is proposed that ai 
adults grow older they encounter fewer occa 
sions requiring new' learning, and therefore 
the habits of learning they developed during 
formal schooling and in the early years o 
maturity have deteriorated through lack o 
practice. To illustrate this concept in thi 
classroom setting, the individual who has 
been out of the routine of formal schooling fo 
any appreciable length of time is likely U 
have lost a substantial portion of whatever hi 
may have known about how' to learn. The ref 
erence here is to such tools of learning a* 
knowing how to study, how to concentrate oi 
focus attention, how to organize work, how' t( 
take notes, and a myriad of other mental ad 
justments and attitudes toward the process 
of learning. 

Those who have taught courses enrolling 
people who have been out of the school routint 
for some time no doubt have had the experi- 
ence of dealing with students w'ho after the 
first class meeting gather at the lectern to 
express serious doubts about their ability to 
compete in an academic setting. To be sure, 
some of these older students are merely hav- 
ing problems in rearranging the priorities of 
their daily lives to find time for studying, but 
there are those who are genuinely concerned 
about recapturing their skill in the mechanics 
of learning. 

While the learning set hypothesis was 
couched in terms of chronological age, it 
should be noted that age, per se, is not the 
critical independent variable. The critical 
variable seems to be the cognitive style of 
life of the individual, that is, individuals who 
are more or less continuously engaged in 
making use of the tools and techniques of 
learning should suffer little or no deteriora- 
tion in learning set. Older adults who have 
maintained learning sets may be expected to 
perform more nearly like young adults than 
will those who have not maintained learning 
sets. Some evidence bearing on this point 
comes from the study conducted by Levinson 
and Reese . 11 They compared the performance 
of children, college students, institutionalized 



and community-dwelling aged, and retired 
college faculty on a classic Harlow-type ob- 
ject-quality discrimination learning set series. 
Performance increased with age in the early 
years, reaching a peak in the college-age 
group, and decreased with age thereafter. Of 
particular interest, however, was the finding 
that the retired faculty were markedly supe- 
rior to the other aged subjects. Levinson and 
Reese suggested than “an initial high IQ and/ 
or considerable educational achievement may 
b? more significant variables than CA (Chronol- 
ogical Age) . . Presumably the learning abil- 
ity of older Ss and their capacity to deal effec- 
tively w T ith large amounts of incoming informa- 
tion is maintained by large amounts of educa- 
tional experience.” 14 

The first of the planned series of studies 
in the Syracuse research program was a 
learning set investigation. lft The major pur- 
poses of this study were to examine sugges- 
tions that there are, in addition to the deficit 
due to loss of response speed witli age, defi- 
cits in concentrating or focusing upon the ma- 
terials to be learned. The paired-associate 
paradigm was used. The anticipation interval 
was held constant and the inspection interval 
varied to test the hypothesis that the perfor- 
mance of older subjects would suffer more 
than that of younger subjects when the time 
allowed to review the stimulus-response pair 
was limited. Furthermore, it w’as conjectured 
that if the predicted deficit w r as due to diffi- 
culty in concentrating or focusing upon the 
materials at a fast pace, then the age differ- 
ence should be reduced if subjects were given 
the opportunity to accustom themselves to the 
experimental situation, in other words, to 
foim a learning set. Therefore, each subject 
successively learned six different lists of 
paired associates. 

The subjects were forty women, twenty in 
their thirties and twenty in their sixties, all 
recruited from women’s religious organiza- 
tions through the technique of offering to pay 
the organization a nominal .sum for each mem- 
ber participating. Older and younger subjects 
did not differ at the .05 level of confidence 
either in mean score on a twenty-item vocab- 
ulary test, nor in mean number of years of 
schooling. The average subject had finished 
high school and had some post-high-school 
training, such as business school, nurses' 
training, or some college. The ycunger wo- 
men were all housewives and mothers active 
in parochial school activities, while the older 
for the most part were either currently em- 
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played or recently retired from clerical types 
of work. In summary, both the older and the 
younger subjects were active, involved, com- 
munity-dwelling individuals of a reasonably 
high educational level. 

Subjects were randomly assigned to one of 
two conditions of presentation of six twelve- 
pair lists. In the slow pace condition subjects 
learned the lists to a criterion of one perfect 
recitation, or a maximum of nine trials, at a 
four-to-two-second rate, that is, four seconds 
anticipation time and two seconds inspection 
time. In the fast pace condition subjects 
learned to the same criterion at a four-to- 
one-second rate. The presentation device was 
a Stow’e memory drum. The pairs of words 
were all two-syllable adjectives, and the six 
lists had been approximately equated for dif- 
ficulty in a pilot study. Nevertheless, tw T o of 
the six lists appeared equally often in the 
first and sixth positions of presentation to 
provide complete counterbalancing of residual 
inequalities in list difficulty at the end points 
of the learning sequence. The other four lists 
w’ere assigned randomly to the second through 
fifth positions of presentation in such a way 
that each subject within each age by pace con- 
dition learned the six lists in a different or- 
der. Thus, the relationship between the groups 
and the relationship of the fust to the sixth 
list learned were not confounded vvith residual 
inequality in list difficulties. 

Figure 1 show r s the mean number of total, 
omission, and commission errors in the study 
of learning set and table 1 gives the results of 
the repeated measures analyses of variance. 
Individual comparisons for the measure of to- 
tal errors showed that the older group at the 
slower pace and the younger group at the 
faster pace improved significantly from the 
first to the sixth list learned, while the other 
two groups did not change significantly from 
the beginning to the end of the series. Since 
the lists did, in fact, differ in difficulty in 
spite of the pilot work done to equate them, 
it is not possible to say unequivocally that the 
sharp improvement shown by all groups but 
the older at the fast pace from the first to the 
second position was due solely to learning set 
formation. 

The most unusual finding, for which (here 
is no ready explanation, w T as that the best- 
performing group w r as the older group at the 
slower pace. As expected, however, the older 
group at the faster pace was worst, and the 
tw’o younger groups did not differ substan- 
tially, although the younger at the faster pace 

51 



Table 1 



Summary of A no lyses of Variance of Error Measures aver Six Lists 



Source of 


df 


Total 

Errors 


Omr ssron 
Errors 


Commi ssion 
Errors 


Vari ation 


Mean 


F 


Mean 


F 


Mean 


F 






Square 




Square 




Square 




Between Ss 
















Age (A) 


1 


273.1 


<1 


199.8 


<1 


5.7 


<1 


Pace (P) 


1 


5078.4 


4.6* 


3667.5 


4.6* 


175.1 


2.1 


A X P 


1 


4437.6 


4.1 


2059.2 


2.8 


451.0 


5.3* 


Error 
















(between) 


36 


1091,6 




733.2 




84,5 




Within Ss 
















Li sts (L) 


5 


237.1 


37" 


170.1 


3.4** 


20.2 


1.8 


A X L 


5 


123.2 


1.9 


55,8 


1.1 


21.4 


1.9 


P X L 


5 


50.7 


<1 


38,0 


<1 


8.6 


<1 


A X P X L 


5 


154.7 


2.4 


.2.2 


1.4 


17.6 


1.6 


Error 
















(within) 


180 


64.0 




50.7 




11.2 





Note: All figures colculated to two decimals, rounded to one. Means and variances for total and omission 



rrors were correlated; however, there wos no chonge in locus of significance after squore root 



transformation of raw scores. 

* = P <.05 
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** = pC.Oi 



Fig. 1 : Performance of Ss on six successi vely-learned lists of paired assoc ctes in 
terms of total, omission, and commission errors. The first letter of the label refers to 
age (0 = 01d, 60-69 voars; Y = young, 30-39 years) and the second to presentation pace 
(5- slow, 4:2-see; F=fast, 4:l-sec). 
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Ordinal List Position 



did perform worse than those at the slower 
pace at all list positions but the sixth in total 
and omission errors. Surprisingly, also, the 
main effect due to age was not significant in 
any analysis. In accordance with prediction, 
however, the main effect due to pace was sig- 
nificant and in the expected direction for the 
total and omission errors. 

The reader should be reminded that it was 
hypothesized that (1) if the faster pace affected 
the older subjects as predicted, then the defi- 
cit might in part he due to an age-related dif- 
ficulty in concentrating upon the materials to 
be learned, and 8) giving subjects the oppor- 
tunity to accustom themselves to the pace, the 
materials, and the presentation device, that 
is, to form a learning set, would ameliorate 
the difficulty. This hypothesis appeared to be 
borne out for the older subjects at the slower 
but not at the faster pace. It might be conjec- 
tured that the older subjects at the faster 
pace did, indeed, form a learning set, but that 
they learned something other than what the 
experiment intended. That is, after a list or 
two they learned that the easiest way out of 
the situation was simply to wait out the maxi- 
mum nine trials, responding only to those 
items that came easily. A follow-up experi- 
ment might be done profitably comparing the 
conditions of (his experiment with a condition 
in which subjects are instructed that they 
must reach criterion. 

PRESENT STATUS AND THE FUTURE 

This portion of the presentation will be 
devoted to summarizing plans and accom- 
plishments of the Syracuse project aiid to a 
brief review of some interesting side issues 
that have developed since the original proposal 
for the program of research was formulated. 
As noted earlier the research program has 
two major aspects, the first involving the de- 
termination of adult age differences in cogni- 
tive abilities, educational background, and 
learning orientation. 

Cognitive Abilities 

It was decided at the outset of the research 
program that an exploration of adult intellec- 
tual functioning might be accomplished pro- 
fitably with a number of tests utilizing a wide 
variety of different types of item3. To this 
end several vocabulary tests were fashioned, 
each designed to tap different areas of every- 
day knowledge and each containing items de- 
signed to appeal to different adult age levels. 



The original forms went through a prelim- 
inary analysis that resulted in the temporary 
shelving of some of the tests due to poor item 
characteristics. Those shelved for possible 
later reconsideration dealt with arts, pas- 
times and hobbies, sports, fashions in attire, 
and current affairs. 

The six tests retained for further imme- 
diate development were those which dealt with 
finance, religion, transportation, life termi- 
nation, slang, and new words. These tests 
were revised to exclude weak items and were 
administered to 151 adults recruited from 
community organizations and to 161 adults 
recruited from adult students enrolled in the 
graduate school of education. The latter were, 
for the most part, teachers in service work- 
ing part-tin. e toward permanent teaching cer- 
tificates. While the main purpose of this 
administration was the assessment of item 
characteristics without regard to age, some 
interesting data on adult age differences in 
performance were revealed. 

The transportation test concerned know- 
ledge of vocabulary related to various modes 
of transport, from the horse-and-buggy era 
to jet aircraft and rockets. The subjects were 
split at the median on age, 30.5 years. Total 
scores for the two age groups were compared. 
A very small but highly significant difference 
was found, favoring the older group. It should 
be noted that the graduate students, presum- 
ably the better educated, bulked dispropor- 
tionately large in the under-thirly group. It 
appeared that experience, rather than formal 
education, was the more important factor in 
performance on this test. 

Analysis of the slang test was handled 
differently. This test was constructed by 
sampling slang dictionaries, which gave an 
approximate date of the first use of the words 
or phrases. The subjects were divided into 
three age groups — under thirty, thirty to 
fifty, and above fifty years — and [he percent- 
age of each group correctly answering each 
item on the test was calculated. The items 
were then segregated into two groups, those 
correctly answered by increasing proportions 
of older subjects, and those increasingly dif- 
ficult for older subjects. Happily for the hypo- 
thesis, of (he twelve items passed by increas- 
ing proportions of older subjects, ten first 
were used before 1950, the median date of 
entry being 1922. Of the ten items failed by 
increasing proportions of older subjects, only 
one entered usage prior to 1950. It should be 




5-1 




emphasized that this was an informal analysis 
of. data which had. been gathered for quite 
another purpose — specifically, for the as- 
sessment of item quality independent of age 
of subject — but the results were most heart- 
ening. 

The original hypothesis guiding the con- 
struction of the items for the life termination 
test was that familiarity with certain kinds of 
illnesses and with death would be greater 
among older than among younger adults. Again, 
as with the transportation test, subjects over 
thirty obtained a slightly higher, but statisti- 
cally significant, mean score than did subjects 
under thirty. Again, this was true despite the 
fact that the younger group had a dispropor- 
tionately larger number of graduate students. 

The finance test yielded results similar to 
those obtained for the transportation and life 
termination tests. Those over thirty scored 
significantly higher in average total score, a 
not unexpected result if one assumes that 
older individuals have had more experience in 
the management of money and property. 

At this point, tv/o of the six tests entering 
the analysis were temporarily shelved. The 
religion test was found to be too difficult for 
subjects, regardless of age. The items were 
highly intellectual in nature, asking questions 
about religions such as Islam and Shintoism 
as well as Judaism and Christianity. The test 
will be reconstituted since there is evidence 
indicating age-related shifts in religiousness. 
The other test shelved was the new words test 
because of an inability on the part of the ex- 
perimenters to characterize its content ob- 
jectively. It had been constructed by sampling 
the “Addenda" to the Merriam- Webster Third 
New International Dictionary. A new test is 
being constructed from a list of words that 
appeared in the Third New International but 
did not appear in the 1909 edition. The list 
was constructed from a stratified random 
sample of the pages of the two dictionaries. 

Plans for the future in the area of cogni- 
tive abilities include continued development 
of these special vocabulary tests, construc- 
tion of additional vocabulary tests and other 
types of tests, and a continuation of develop- 
ment of a short but reliable vocabulary apti- 
tude test with two equivalent forms. 

Educational Background 

As noted earlier, the major instrument for 
the collection of data on the educational level 
of adults of various ages is t.’v* Adult Haste 
Learning Examination, which contains sub- 
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scales relating to arithmetic computation and 
problem solving, reading comprehension and 
memory for what has been read, spelling, and 
vocabulary. In late January, 1969, a form of the 
ABLE (Level III) was administered together with 
several tests from the Syracuse project, and 
biographical data was obtained on over five hun- 
dred individuals of both sexes, ranging in age 
from the late fifties to the late eighties. At the 
time this paper was prepared, no analysis of the 
data had been done. Arrangements are being 
made to collect similar data from union mem- 
bers, adult trainees in a technical institute, and 
adults enrolled in continuing education programs, 
filling out the sample with adnlts of all ages 
from the twenties through the eighties. 

Learning Orientution 

Plans are underway to begin data collec- 
tion in the area of learning orientation in the 
near future, using either the instruments 
created by Ingham and by Litchfield, or modi- 
fications of these instruments. 16 A review of 
the literature is in progress in this area to 
determine the approach to be taken. 

Experimental Studies 

The second major aspect of the Adult De- 
velopment Study is the experimental investi- 
gation of the interaction of age with various 
personal characteristics in determining learn- 
ing and performance. Two experiments, one 
on the effects of the manipulation of social 
stress on performance of cognitive tasks, and 
one on learning sets and age, have already 
been described. A brief description of other 
experimental work follows. 

In a dissertation research project recently 
completed in the Syracuse laboratory, Hultsch 
investigated the ability of males of different 
ages to organize material to be recalled 17 A 
sixteen-trial free-recall task was given to 
males aged sixteen to nineteen years, thirty 
to thirty-nine years, and forty-five to fifty- 
four years. Subjects (Ss) were required after 
each trial to write down as many of the twenty 
words presented as they could recall. Three 
instructional conditions were used: (1) the Ss 
just were asked to recall as many words as 
possible; (2) it was suggested that recall would 
be easier if the words were organized in some 
unspecified way; and (3) Ss were told to al- 
phabetize the words as an aid to recall. Hutsch 
found that the older Ss recalled fewer words 
than the high school seniors, although no dif- 



ference was noted between the two older 
groups. Furthermore, with the alphabetization 
instructions those of all ages performed best, 
but the interaction of age and instructions was 
not significant. Thus, although the older men 
did not recall as much, what they did recall 
was as well-organized as the recall of the 
younger Ss. The older men were, in other 
words, as able as the younger to use either 
their own or an instruction-induced organiza- 
tional scheme. 

In a later reanalysis of the data, Hultsch 
divided each of the three age groups into two 
subgroups on the basis of their scores on a 
vocabulary test, and looked at the free-recall 
performance of individuals with high as op- 
posed to low verbal facility. 18 In this ve*ana* 
lysic he found no significant age differences 
among the high verbal facility groups, nor 
were there differences due to instructional 
condition among these? groups. However, a 
significant age and instructions interaction 
was detected in the low verbal facility groups, 
Under both the standard instructions and or- 
ganizational instructions conditions, the high 
school boys recalled more words than the 
two older groups, which did not differ from 
each other; however, no age differences were 
detected among subjects performing under 
instructions to alphabetize their recall. 

The presence of an age decrement in the 
case of low verbal facility individuals, but 
not among high verbal facility people is quite 
interesting, particularly since it becomes 
apparent at a comparatively early age, that 
is, between. the late teens and the age of 
forty. Why this should be so is difficult to de- 
termine. It does appear, however, that at least 
part of the age-related decrement in recall 
performance was attibutable to an age-related 
decrement in organizational processes. It may 
be that providing people of lower verbal facil- 
ity with a method of organizing material to be 
learned and recalled reduces age decrements 
in performance. Hultsch is presently following 
up on several suggestions produced by this 
research. 

While the Syracuse study has no further 
data comparing different age groups at the 
time of this report, some of the pilot work 
done shows promise of illuminating the inter- 
action of age and performance further. As 
has been mentioned in passing, it has been the 
practice in this project to run pilot studies 
using as subjects adults enrolled in courses 
in the late afternoon and evening divi don of 
the graduate school of education. These girab 



late students arc, of course, people of higher - 
than-average intelligence and educational at- 
tainment, and their ages form a positively 
skewed distribution. The median age is rough- 
ly twenty-five, the mean about thirty, and the 
oldest ages represented rarely are greater 
than fifty to fifty-five. Nevertheless, some in- 
dications can be obtained as to the usefulness 
)f the experimental manipulations and meas- 
ures, thus saving the harder-to-eome-by 
community-dwelling adults for refined in- 
vestigations. 

One study using graduate students as sub- 
jects tried to take advantage of the life-long 
habits of people to read from left to right and 
to observe the results of reversing the pro- 
cess. In the pilot study the students learned a 
list of paired associates in the usual fashion, 
stimulus presented on the left and response 
term on the right. Another group of students 
learned the same list with the stimulus and 
response terms reversed in position, in other 
words, arranged from right*to-ieft, A differ- 
ence significant at the .05 level favoring the 
left-to-right group in mean number of trials 
to criterion was found. This task is presently 
being used with adults varying widely in age 
to test the hypothesis that older people will 
find it more difficult than younger adults to 
overcome the left-to-right habit. 

Work earlier done on age differences in 
learning set development is also being fol- 
lowed-up. One study currently in progress is 
examining the hypothesis that a subject’s ap- 
prehension or anxiety about participating in a 
learning situation is, in part, a function of the 
difficulty of the task. Furthermore, it is hypo- 
thesized that the older the adult, the greater 
will be the disturbance produced by a difficult 
as compared to an easy task. Thus, learning 
set development will be slower if it is accom- 
plished by exposure to more difficult mater- 
ials, and especially slower in older adults. 
The experimental approach is to expose half 
of an age group to three difficult list of paired 
associates, followed by three easy lists. The 
other half of each age group will learn the 
three easy list first and then the three diffi- 
cult lists. The specific predictions arc that: 
(1) the learning rate of the older subjects 
more closely will approximate the rate cf the 
younger subject on lists later in each series 
than on lists earlier in that series, (2) the 
improvement in learning rate over each of the 
series will be greater for the older subjects 
than for the young, and (3) these differences 
will be accentuated in the learning of difficult 



over easy material. Of course, the first two 
comparisons above represent two ways of 
assessing the same outcomes. 

In the experimental area, major future 
goals are related to the three main hypotheses 
earlier articulated. Plans have been laid to 
investigate the effects of various kinds of 
stress, of favorable, unfavorable, and neutral 
attitudes, and of previous experience or 
learning sets on the learning and perform- 
ance of adults of different ages, sexes, and 
socioeconomic backgrounds. 

Thus far, the experimental work has not 
bam concerned with verbal materials of a 
very high degree of complexity. Future work 
will have little concern, except incidentally, 
with standard laboratory apparatuses and 
verbal material such as memory drums and 
paired words. Sentences, short paragraphs, 
and longer passages of verbal materials have 
been constructed to use in learning and per- 
formance tasks. In short, plans are to move 
closer and closer to the kinds of learning 
tasks faced in real life by real adult learners, 
while at the same time exercising control over 
the experimental and personal variables indi- 
cated by the hypotheses. 

CONCLUDING REMARKS 

The findings of the Adult Development Study 
hopefully will help to dispel the feeling of 
hopelessness exemplified in the saying, “You 
can't teach an old dog new tricks.” There is 
evidence to suggest that this is an attitude 
held both by those engaged in working with 
older adults and by the older adults them- 
selves. There are, unquestionably, losses 
with age in factors associated with perform- 
ance, such as in acting or reacting in situa- 
tions requiring the overt display of acquired 
knowledge. There is, however, no good evi- 
dence at this time to indicate that the funda- 
mental ability to learn decreases until very 
late in life. There is certainly no evidence for 
decline in this basic ability during the normal 
working years — up to and including the middle 
and late sixties— for most people. 

It must he realized that an individual's 
expectations are powerful determiners of both 
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his behavior and the behavior of those he in- 
fluences. This has been graphically demon- 
strated by Rosenthal in his work with elem- 
entary school teachers and their students, and 
even with tesearch psychologists expecting 
certain kinds of performances from animals . 19 
In one experiment Rosenthal and Jacobson 
divided a group of elementary school pupils 
into two subgroups / 20 The pupils in one group 
identified to their teachers as children who 
were about to bloom intellectually. The other 
subgroup was equally quali ied but was not 
specially identified to the teachers. At the 
end of a few months it was found that the 
“bloomers” had, indeed, showed increases in 
achievement significantly greater than the 
control subgroup. The preferred explanation 
for this finding was that the teachers expected 
the specially-marked children to bloom and 
that through their interactions with these 
children they had subtly, and perhaps not-so- 
subtly, communicated their expectations to 
the children and had provided an environment 
that had stimulated and supported the child- 
ren’s efforts. 

A possible message for those involved it 
adult learning is that expectancies should, at 
the very least, be realistically based and, ir 
appropriate circumstances, biased to favor a 
desirable outcome. It is the scientist’s busi- 
ness to determine the shape of reality, but it's 
the educator’s business to reshape reality. 
Thus, the scientist’s expectancies must be 
controlled, but the educator is free, within the 
limits of good conscience and good sense, to 
mold expectancies in order to further educa- 
tional and personal development. It should not 
be necessary to point to the potential for mis- 
chief and misfortune inherent in unethical or 
ignorant manipulation of expectancies, how- 
ever. Everything is moderation! 

To summarize, what one expects of the 
“old dog” confronted with a “new trick ' 1 ma; 
be as important as the technique one uses foi 
teaching him the trick. It is the expectation of 
the Syracuse research group that what is 
learned about the capabilities and limitations 
of adults of various ages will give adult edu- 
cators a foundation on which to base, and a 
bias for, their expectancies for their students. 
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ADULT DEVELOPMENT 



Jack Botwinick 



This discussion covers issues relating both 
to problems of research in gerontological psych- 
ology and to the findings of such research. Under 
the heading Aspects of Research, research growth 
and methodology are considered. Under the head- 
ing Aspects of Man, intelligence, speed, learn- 
ing, perception, and personality are discussed. 
A very brief summary is given in conclusion. 

ASPECTS OF RESEARCH 

Growth 

Anyone who has tried to keep up with the pub- 
lished literature on aging must have a sense of 
apprehension, a growing feeling that a day soon 
will be reached when his effort will be futile. 
The day is almost at hand when it is possible to 
keep abreast of only the most specialised of 
interests, 

Figure 1 tells part of the story- We are 
currently collecting and selecting references 
for a chapter in the Annual Review of Psych 
oloyy As the name suggests, it is a once-a- 
vear publication in which different substantive 
areas in psychology are covered. Not all areas 
are reviewed annually, however. Gerontology , 
for example, has been reviewed approximately 
every five years beginning in 1951- The remark- 
able record of growth in research seen in figure 
1 is even more impressive when it is realized 
that the review by Shock, covering the period 
January, 1947, to June, 1950, included many 
older key references. 1 The number of refer- 
ences published during the period of I^orge’s 
icview was probably greater than that published 
during the period of the review by Shock, al- 
though figure 1 does not reflect this. 2 

Figure 1 may provide a broad view of the 
growth in research, but the specific counts of 
the numbers of publications from review to re- 
view may be spurious and misleading; for exam- 
ple, the reviewers may w A\ have had varying 
interests and criteria in selecting the refer- 
ences. If they did, the extensity of research, as 
contrasted with the actual number of publica- 
tions, may be reflected in figure 1. Also, the 



references wera listed differently: Chown and 
Heron, in listing 252 references, ^ indicated that 
the amount of literature within the five-year 
period covered by their review kept pace with 
the amount during the previous five-year period, 
reviewed by B>renJ Birren listed 378 refer 
ences. In spite of these considerations it is 
difficult not to be impressed by the trend line 
Seen in figure 1. Extrapolate the curve and pity 
the poor reviewer of 1975. Gerontology chapters 
now need to be reviewed every year or at least 
every other year. 

Method 

Were the studies represented in figure 1 
carried out with the best possible experimental 
methods? Most studies of aging involve the com 
parison of two or more age groups. Tins cross- 
sectional method has received much criticism 
in recent years, mainly on three counts: (1) the 
method dees not pumit following a single per- 
son over time; (2) more often than not, there 
is a systematic bias in the types of people sam- 
pled across the age range; and (3) the cross- 
sectional method reflects cultural changes as 
well as age changes since there is greater ex- 
posure to ne\v information, more opportunities 
to learn, ard different methods of solving prob- 
lems from one generation to the next. When a 
comparison is made between a twenty year-old 
and a seventy- year- old, the comparison in- 
volves these generational differences. All three 
criticisms are correct. 

When criticism is leveled at the cross- 
sectional method, the solution that is most typi- 
cally offered is the longitudinal method. The 
longitudinal method involves testing the same 
subject with the same *ests periodically as he 
ages. The period between tests usually is a mat- 
ter of years. The longitudinal method has much 
to recommend it, but it is no panacea. It is only 
partially effective ar. ' - s not necessarily con- 
trol for all cultural changes. In addition, as will 
be seen, it reflects artifacts of testing and cur- 
rent environmental factors. 

One often hears it said that cross-sectional 



References 



The number of cited references in the reviews of adult aging of the Annual Review of 
Psychology. Solid lines represent actual counts, except for the 1970 review which is a ciose 
estimate. Doshed lines represent approximations of the minimum number of published reports 
which needed to be exomined, and which could hove been listed. 




61 



4 / 



studies show age decrements in performance and 
longitudinal studies do not. This is questionable. 
A careful review of longitudinal studies of intel- 
ligence suggests that while most of the investi- 
gators concluded from their results that there 
was little or no age decrement in intellectual 
function in later life, the available data indicated 
otherwise. 5 The data based on people of average 
intelligence have shown, in general, what cross- 
sectional data have shown, but with less pro- 
nounced decline. 

A study by Riegel, Riegel and Meyer is en- 
lightening. 6 They gave a variety of psychological 
tests to 380 subjects over fifty-five years of age. 
They retested five years later and some subjects 
refused to cooperate by being tested again. Others 
died or became ill and could not be tested. When 
those subjects who were retested were compared 
with the total group, they svere found to be signifi- 
cantly better. The authors concluded: (1) develop- 
mental trends are based upon increasingly biased 
samples, and (2) previous longitudinal studies 
have underestimated the amount of this drop out 
in subject availability. Their conclusions suggest 
that longitudinal data, as well as cross-sectional 
data, do not reflect the total extent of decline. 
Typically it is the initially less able who are not 
available for later retest. 

Is there any method that is foolproof? No, 
the^e does not seem to be one, but there is a 
grouping of methods whit h is more adequate than 
any one method alone. This grouping combines 
cross-sectional, longitudinal, and one other type 
of group comparison. Unfortunately, this group- 
ing of methods is impractical, or at least diffi- 
cult, to carry out, but it provides us with a 
standard. Schaie developed this approach and it 
is one of the most important contributions to 
methodology in developmental research yet 
offered. 7 

Schaie’s approach is as follows: Let us 
carry out a cross-sectional study and arrange to 
test subjects who w r ere bom in either 1920, 1910, 
or 1900. In this year, 1969, they w r ere aged 49, 
59, and 69 years. This group comparison con- 
founds age and the effects of generations of cul- 
ture. The study should be planned so that the test 
of the oldest sample is also the last longitudinal 
retest of a three-step, tw-enty-year study. The 
subjects bom in 1900 were tested in 1969, 1959 
and 1949, and w T ere therefore 69, 59, and 49 
years old during the three testing periods. This 
longitudinal comparison confounds age and time 
of testing. The time of testing involves errors 
of measurement due to factors such as changes 
in the tester and in test-situation environments. 
Then make the last group comparison. If during 







1969, 1959 and 1949 only subjects ages 69 years 
w r ere tested, they w'ould have been born in 1900, 
1890 and 1880 respectively. This group com- 
parison does not involve age, it simply confounds 
effects of culture and time of testing. Schaie’s 
analysis permits comparison of the relationships 
involving age effects, culture or generational ef- 
fects, and test environment or errors of meas- 
urement effects. Since each group comparison 
involves a different two of the three contributing 
sources of variation, the confounding normally 
seen with each comparison alone may be un- 
tangled, 

ASPECTS OF MAN 

In this paper reference to young adults 
usually means people in their twenties, extending 
into the thirties and dipping into the late tee. is. 
Reference to elderly people, the aged or the old, 
usually means sixty-five years and over. Some- 
times it means people in their early sixties. 

Intelligence, That Which 
the Test Measures 

It was said that developmental growth curves, 
determined either by the cross-sectional method 
or by the longitudinal method, are based upon in- 
creasingly biased samples of subjects as one 
moves up the adult age periods. The initially su- 
perior tend to survive and be available for late- 
life testing, and the initially inferior die or other- 
wise become unavailable. 

Idle fact that over time the proportion of 
initially superior subjects in the sample increases 
becomes disquieting when one examines the de- 
velopmental curves of intelligence in later life 
and finds that they are curves of decline. If the 
initially less able were more adequately repre- 
sented in the older age groups, the trend of de- 
cline would be even greater. It is necessary, 
howrever, to keep two issues in mind when con- 
sidering developmental curves. First, individual 
differences are so great that w'hen dealing with 
persons rather than with groups, the curves may 
actually be misleading. The curves probably re- 
flect much of w’hat is in the general nature of 
man, but they do not reflect much about any one 
particular man. To know T about one particular 
man, it is necessary to test him individually. 
It is not possible to predict the individual from 
the group. A second reason for not being over- 
whelmed by developmental curves of intelligence 
is (hat the decision of which test to use, or what 
items to include in constructing a test to meas- 
ure intelligence is crucial. Intelligence is in part 
defined by decisions about tests, and the age 
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changes in intelligence are measured by those 
tests. For example, Demming and Pressey re- 
ported results of a test based on practical tasks 
in which they tested subjects on the use of the 
yellow pages of a telephone directory, on common 
legal terms, and on obtaining services needed in 
everyday life. 8 They found a rise in scores 
through the mi j and later years with this test, 

even when th T declined in their test 

scores with the conventional tests. 

Demming and Pressey’s results demon- 
strate that not all functions decline with age. 
Moreover, those functions that do decline do so 
at varying rates. Developmental curves of adult 
intelligence based upon the Wechsler tests (1944, 
1948} clearly show a varying rate of decline. 
Each version of the Wechsler test comprises 
eleven subtests, and each of these subtests re- 
flects a different rate of change with age. To 
exfimine this variation comprehensively, the 
results of ten aging studies based upon the 
Wechsler tests were combined. 9 In each of the 
ten studies the subtests were ranked to show how 
elderly subjects performed on them. In this 
report, 11 represented the best score and 1 tht 
poorest score; for example, if in one study a 
group of elderly people w’ere found to have per- 
formed best in the vocabulary subtest, vocabu- 
lary would be ranked 11. If in another study the 
subjects performed second best in vocabulary, 
it would be ranked 10. The mean rank of vocabu- 
lary, combining these two studies, would be 10.5. 
Ihe results of this analysis may be seen in 
figure 2. 

E'lgure 2sho\vs thatthe subtests Information, 
Vocabulary, and Comprehension are the three 
highest ranked ana Block Design, Picture Ar- 
rangement, and Digit Symbol are the thr*e low- 
est ranked. These rankings are remarkably simi- 
lar across the ten studies. They reflect what has 
been referred to as “the classic aging pattern.” 
A group of functions referred to as “verbal” hold 
up with increasing age, and a group of functions 
referred to as “performance” do not. However, 
performance is a poor term since all assess- 
ment is based on some aspect of behavior, in- 
cluding verbal performance. Not only do func- 
tions such as vocabulary seem to hold up with 
age, but in very bright people vocabulary sccres 
have been found to improve witn age. 

What do the top and bottom ranked subtests 
seen in figure 2 measure? When similar data were 
examined with the highly mathematical technique 
of principal component analysis, Birren, Bot- 
winick, Weiss, and Morrison suggested that 
tests similar to the three top-ranked subtests in 
figure 2 measure achievement and tend to be re- 




lated to general experience in our culture. 10 
This achievement and experience can be regarded 
as stored ii formation. Performance tests, such 
as the bottom three in figure 2, seem to measure 
manipulative skills, perceptual functions, and the 
processing of new information. 

Speed of Response 

Involves Attentive Expectation 

The specific procedures involved in the sub- 
tests listed in figure 2 invjlve speed of respond- 
ing for the bottom-ranking tests but not for the 
top-ranking tests. This observation led to a con- 
troversy regarding the significance of loss of 
speed in old age. One extreme held that the ob- 
served slowing is a matter of the muscles only 
and thus is of no consequence to cognition. Psy- 
chometrically, it was argued, speeded tests are 
unfair ana inappropriate for testing the elderly. 
The other extreme held that speed of response 
is a reflection of central nervous system func- 
tioning and as such is crucial to cognition. Pro- 
ponents of the latter view held that speeded tests 
are not only appropriate in testing the elderly, 
but are desirable and necessary. This contro 
versy has been discussed in greater detail in a 
different report where still a third view was 
described. 31 

Doppelt and Wallace gave the Wechsler 
test (WAIS) both with and without time limits, 
and the age patterning of scores was essentially 
the same in both conditions. 12 From a psycho- 
metric viewpoint, therefore, the controversy 
centering upon speeded tests no lonycr seems 
ol great importance. From the point oi view of 
understanding the loss of speed, however, ques- 
tions remain. What are the antecedents of the 
lo.;s? Does the loss of speed affect skills and 
other perform a nces? Most studies seem to show 
that slowing with age is more than just a matter 
of the muscles. It still is not clear w’hether the 
loss of behavioral speed is a reflection of slowed 
rates of neural conduction within the central 
nervous system. Studies have shown, however, 
that behavioral slowing may be a function of 
transient states of the responder; for example, 
the readiness or state of expectation of the re- 
sponder determines how quick he can be. 

The literature relating to (he issue of 
readiness is extensive and very technical, and it 
is only necessary to describe here a few studies 
which highlight main points. Weiss, and later 
Botwinick and Thompson, segmented reaction 
time (RT) into two component parts — premotor 
time. 11 Premotor time includes the time it takes 
to process the input of the stimulus and to asso- 
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ciate this input with the appropriate behavior. 
Motor time is essentially the peripheral, muscle 
portion of RT. Elderly adults were found to be 
slower than young adults in both the premotor 
and motor components of RT. The premotor 
component was regarded as the more important 
because it constituted approximately eighty-four 
percent of the total RT, and because it parallelled 
RT in its relation to an experimental manipula- 
tion of states of attentive expectancy. 

Attentive expectation of an environmental 
event — that is, stimulus — permits the responder 
to get set and respond quickly. Conversely, when 
a person is surprised by the stimulus, either 
because he did not expect it or because he ex- 
pected its arrival at a different point in time, he 
responds slowly. RT is fastest when the condi- 
tions of anticipation or expectancy are optimal; 
RT is slowest when conditions do not favor 
accurate expectancy. 

In a RT study the conditions of expectancy 
are manipulated by the preparatory interval 
(PI), which is defined as the duration of time 
between a warning signal and the stimulus indi- 
cating the need for response. If the PI is the 
same from one RT trial to the next, it is called 
“regular,” and if the PI is varied from one RT 
trial to the next it is ‘"irregular.” The extent 
to which elderly and young people differ in speed 
of response dtpends not only upon whether the 
PI is regular or irregular, but upon the specific 
time duration ot the PI; for example, figure 3 
demonstrates variations in RT of men respond- 
ing to a visual stimulus with regular Pis. It can 
be seen that when the PI is long, that is, 6.0 
seconds, the difference in RT between old and 
young is nearly twice that when the PI is short, 
that is, 0.5 second. One reason for the differ- 
ence of RT with length of PI by age is that with 
longer periods of sustained expectation, attention 
and concentration are taxed. It is with the taxing 
of attention that the elderly perform particularly 
poorly. It can be seen that even with a task as 
relatively simple as speed of response, the age 
pattern varies as a function of context. Not all 
situations reflect slowing to the same extent; 
some contexts maximize the extent of slowing 
and some minimize it, although almost all situa- 
tions reflect some slowing. 

Learning — Process and Act 

The importance of slowing with age de 
pends upon the extent to which speed is involved 
in a particular act. It is often overlooked that 
what is commonly called “learning” involves 
some behavioral expression which in itself is 
not learning; for example, one must speak or do 



something to demonstrate learning. If loss of 
speed is reflected in the speaking or doing and 
this makes performance poor, it does not mean 
that the learning itself is poor. Psychologists 
emphasize the distinction between learning (the 
process) and performance (the act expressing 
the process). In the analysis of learning in late 
adulthood much effort has been directed to the 
questions of whether learning itself falls off 
with age, or whether it is only the learning per- 
formance that does. 

Laboratory studies dealing with the problem 
of learning versus performance have involved 
simple rote tasks of paired-associate and serial 
verbal learning. In paired-associate verbal 
learning the experimenter presents a series of 
paired words to the subject who must learn the 
pairing. Preceding each pair in the list, the 
first word of the pair (the stimulus word) is pre- 
sented by itself. When the pairing is learned, 
the subject is able to anticipate and supply the 
second word (the response word) without further 
information. 

Canestrari varied the time period between 
w’ord pairs so that he had three pacing or speed- 
of-stimulus-presentation conditions. 14 He had a 
fast-paced condition in w’hich each word pair was 
exposed for only a brief period of time with a 
similar brief period before the next word pair 
appeared. Fast paring made the task one of assi- 
milating rapidly changing information. Can 
estrari also had a condition involving slow’er 
pacing and one in which the subject paced him- 
self. In the self-paced condition the subject con- 
t oiled the apparatus to get as much time be- 
tween word pairs as he desired. Canestrari 
found that the largest difference between an el- 
derly group and a young-adult group occurred 
in the condition of fastest pacing, and the small- 
est difference between age groups occurred in 
the self-paced condition. The results of this 
study may be seen in figure 4 in terms of errors 
in performance. Figure 4 demonstrates that a 
large proportion of the poor learning perform- 
ance seen in advanced age may be accounted for 
by loss of speed, rather than decreased learning 
ability as such. However, it may also be seen 
in figure 4 that the performances of the elderly 
were poorer than those of the young in all three 
conditions of learning, including the condition 
of self-pacing. A learning disability in the aged 
cannot, therefore, be totally ruled out on the 
basis of these data. 

Arenberg carried out two studies, the first 
of which was similar to that of Canestrari. His 
second experiment was more complicated but 
also more informative. Arenberg had elderly 
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Figure 3 

Reaction Time {RT) os a function of the preparatory interval for two age groups. It may 
be seen that the difference between age groups in RT was greater with the longer interval than 
with the shorter. (The graph was drawn from information seen in Figure 3 of Botwinick, 1965a.) 
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and young adults ’earn paired words using a 
procedure in which paced and self-paced trials 
were alternated. One group of each age experi- 
enced fast-paced trials alternated with self- 
paced trials, and a second group of each age 
experienced slow-paced trials alternated with 
self-paced trials. 

The major test in Arenberg’s study in- 
volved a comparison between learning on the self- 
paced trials which followed the slow pacing and 
learning on the self-paced trials which followed 
the fast pacing. If the older subjects had poor 
scores during the fast-paced trials simply be- 
cause of an insufficient time to respond and not 
because of poor learning, then their performance 
during the subsequent self-paced trials would be 
good. On the other hand, if the older people were 
not able to learn during the fast-paced trials, 
then their performances would be poor during 
the self-pacing wdiich followed. Arenberg’s re- 
sults showed that the scores of the older group, 
as compared with the younger group, were 
poorer in the self-paced trials which followed 
the slow-paced ones. His conclusion, therefore, 
was that the poor performance of the old group 
during the fast pacing could not “be attributed 
to insufficient time to emit a correctly learned 
response.” Once again speed of response af- 
fected the performance of the elderly, but poor 
learning could not be ruled out. 

Eisdorfer, Axelrod and Wilkie tested serial 
learning performance for the same purpose of 
distinguishing between the process (learning) and 
the act (performance). 17 In serial learning, single 
words are presented one at a time. The subject 
anticipates the next word in the list and tries to 
verbalize it before the experimenter presents it 
to him. Eisdorfer, Axelrod, and Wilkie presented 
the words to be learned in one of three exposure 
durations — brief, long, or in between. Elderly 
adults improved their learning scores as the 
time allowed for viewing the words was made 
longer. Interestingly, young adults made their 
best scores with the middle exposure durations 
and their worst scores with the longest stimulus 
durations which tells us something about the 
preferred pacing of older and younger people. 
Again, in each condition the scores of the elderly 
subjects were poorer than those of the younger 
ones, possibly reflecting a true learning deficit. 

The tasks used in the studies described 
above involved rote learning of material which 
had no relevance for the subject. What data are 
available with regard to meaningful life tasks? 
The number of studies involving meaningful life 
tasks is limited and they are often of poor scien- 
tific quality. The more an investigation is cen- 
in the factory or in other natural settings, 



the more difficult it is to have proper experi- 
mental controls. Shooter, Schonfield, King, and 
Welfjrd reported that the results^f studies in 
natural settings tend to fall into four categories. 18 
To assess competence, workers are either: 
(1) graded in examinations taken during or at 
the end of training programs; (2) rated by train- 
ing staff; (3) marked on the basis of length of 
training necessary to reach a given criterion of 
performance; or (4) evaluated by measuring 
the progress of the work itself w’hen training is 
given on the job. The authors indicated that the 
first three types of evaluation tend to show de- 
cline with age, whereas the fourth tends to show 
neither decline nor improvement. 

Perception — The Processing 
of Sense Data 

In later life there is a decrease in sensory 
acuity which diminishes the effective intensity 
of physical environmental stimulation. Diminish- 
ing intensity of stimulation determines in part 
the world in which older people respond, but if 
the decrease in acuity does not reach an extreme 
form, it docs not need to present a very great 
problem. Corrections of sensory acuity can be 
made, as seen by the increasing use of hearing 
aids and stronger eye glasses, as people age 
Corrections are also made by the tendency in 
the aged to rely on more than one sense at a 
time. A famous neurologist, for example, once 
described his observation that young people 
tend to drink water from a glass without any 
apparent visual attention to the glass. The kines- 
thetic and proprioceptive cues are sufficient to 
carry out the drinking. Kovvever, some older 
people, particularly the impaired aged, tend to 
monitor their drinking by a close, visual watch. 

An experimental analysis of the tendency 
for older people to look at what they are doing 
was made by Szafran. 19 He had industrial 
workers of widely varying ages locate targets 
with a pointer under tw r o conditions; (1) when 
direct vision was permitted, and (2) w r hen the 
use of goggles made it possible to see the gen- 
eral display but not the targets or pointers. 
Szafran reported that when older w-orkers w’ere 
unable to make use of vision, they had special 
difficulty in locating the targets. They tended 
to make postural adjustments, turning then 
heads and, olhn, bodies in the direction of the 
particular target to be located. 

How man patterns his world is not only a 
matter of what his senses p : ck up. His central 
nervous system processes the sensory inputs, 
and his decisions and behaviors reflect this 
processing. Szafran’s data may he more reveal- 
ing of the difficulty older people have in pro- 



cessing inputs than of their disability in peri- 
pheral sensory functioning. When a stimulus 
input is ambiguous or weak there are relatively 
large individual differences in the processing 
of the sense data. When the input is unambiguous 
or strong, individual differences in the percep- 
tion of the input are small. Accordingly, ambig- 
uous or weak stimuli are often used in studies 
desigr. ed to examine individual differences. 

Basowitz and Korchin tested a young adult 
and an elderly group of subjects with two tasks . 20 
One task, called Gestalt completion, involved a 
set of drawings. A portion of each drawing was 
obliterated and had to be supplied perceptually 
by the subject. The other task involved finding 
simple geometric figures embedded in complex 
designs. Basowitz and Korchin reported that the 
young gror performed each of these tasks bet- 
ter than the elderly group, but of special inter- 
est was the kind of error the older people tended 
to make. They omitted many items altogether. 
Basowitz and Korchin suggested that the older 
people may have manifested a type of excessive 
caution, “a defensive reluctance to venture re- 
sponse for fear of recognizing their inadequacy.” 

A changing pattern of stimulation was used 
in another study by Korchin and Basowitz . 21 
They compared elderly ana young adults on a 
series of thirteen line drawings. The first draw- 
ing portrayed a cat which by successive modifi- 
cations in subsequent drawings became a dog. 
The most ambiguous drawing was the seventh 
in the series — it was as much a cat as it was a 
dog. "Hie younger subjects changed from “cat” 
to “dog” near the center of the series and con- 
tinued with that response. The older subjects 
tended to shif f from “cat” to “dog” later in the 
series and tended to vacillate more, shifting 
back to the response “cat” after having re- 
ported “dog.” These data were interpreted as 
reflecting susceptibility to novelty and to po- 
tential threat in the situation on the part of the 
elderly. 

Korchin and Basowitz’s study was followed 
up by one by Botwinick in which both the cat-dog 
series and a triangle-circle series were pre- 
sented . 22 The latter series were comprised of 
twenty- two photographs of drawings, the first 
of v/hich was an isosceles triangle and the last 
a circle. The results of this study conflicted 
with those of Korchin and Basowitz, but the in- 
structions to the subjects were different. In the 
study by Korchin and Basowitz the older sub- 
jects shifted percepts later in the series than 
did the young; in the Botwinick study the older 
subjects shifted earlier in the series. The 
instructions used in the Botwinick study were 




more structured than those used by Korchin 
and Basowitz. Korchin and Basowitz asked the 
subject, “Is it a cat or a dog?” — that is, the 
set to shift was not emphasized. They found the 
older subjects to be uncertain and vacillating 
In the Botwinick study, the end point 0 of the 
stimulus series were indicated, the set to shift 
was clearly given, but the opportunity to vacil- 
late was restricted by the termination of the 
procedure at the point of shift. With a very 
structured procedure, there was no uncertainty 
and, of course, no vacillation. Decisive, early 
shift of response was made by the elderly. The 
combined results of Korchin and Basowitz and 
Botwinick suggested the hypothesis that given 
appropriate structural sets rather than the 
opportunity to develop them, the older person 
will respond with minimum difficulty. The prob- 
lem becomes difficult for the aged to the extent 
that a lack of structure, uncertainty, and the 
need to change patterns of thought are promi- 
nent An alternate hypothesis may be that the 
instructions emphasizing shift of percepts were 
more compelling for the old than young. The 
old may have been more susceptible to the in- 
structional set to shift; they may have feared to 
fail reporting the change. 

The inclination to shift percepts was exam- 
ined more directly in tw T o very similar studies. 
In the first, Botwinick, Robbins, and Brinley 
presented young adult and elderly subjects with 
Boring’s ambiguous figure, commonly known as 
“my wife and my mother-in-law” which can be 
seen either as a young woman (wife) or an an old 
one (mother-in-law ). 23 Of those reporting either 
percept, ninety-four per cent of the elderly sub- 
jects reported seeing the “wife” while only 
seventy-eight per cent of the younger subjects 
did. Does this suggest the possibility that for 
the elderly denial of old age was operating to 
affect their perceptual processes? Although this 
question was in mind in the second study, both 
studies had as their central purpose the deter- 
mination of the equality of effects of perceptual 
preparation on young adult and elderly subjects 
in terms of their inclinations to shift from one 
percept to another. 

After the subject reported either “wife” or 
“mother-in-law,” he was encouraged to per- 
ceive the alternate percept. If he could not so 
perceive the alternate percept on his own, he 
was shown a photograph of an unambiguous ver- 
sion of the percept he could not see; for example, 
if a subject saw “wife” and could report the 
alternative percept, he was shown an unambiguous 
photograph ot “mother-in-law.” Later, without 
comment, he was shown the ambiguous photo- 




graph again and asked what he saw. The results 
demonstrated clearly that the older subjects 
tended to keep seeing the same percept, while 
the younger subjects easily reported the alter* 
nate one. The conclusion irom these results 
was that the elderly demonstrated either a 
lower ability to form percepts, a greater diffi- 
culty in reorganizing percepts when formed, 
or both. 

The second study was carried out to rep- 
licate the first, but used a better balanced male 
version of the ambiguous figure, “my husband” 
and “my father-in-law.” 24 It was thought that if 
ninety-four per cent of the elderly saw the 
“wile,” then perhaps this drawing was too 
structured for the elderly to reorganize. The 
results of the study with the male figure were 
essentially the same as those with the female 
figure. Approximately seventy-seven per cent of 
the elderly saw the “husband” as compared to 
fifty-four per cent of the young. Again, reorgan- 
ization of percepts was n A as readily reported 
by the elderly as by the young adults. 

The reason for the eldcily reporting the 
young “husband” percept more often than the 
young subjects again may be that they denied 
old age. However, another explanation is at 
least as feasible and probably more so. In both 
male and female versions of the ambiguous 
figures, the .old percept figure comprised the 
total photograph. The young percept figure 
comprised only a middle section. To see the 
“old” figures called for greater ability in 
perceptual organization or integration than 
seeing the “young" figure. The elderly sub- 
jects may have been more deficient in such 
perceptual organization and integration. The 
study which is necessary in order to tease these 
alternate possibilities apart would involve old 
and young percept figures varied with respect 
to the area of the total figure covered. Such a 
variation might be made along with assessment 
of the subject’s acceptance of and adjustment 
to old age. 

Personality — The Pursuit 
of Self-Esteem 

It should be very clear that complex per- 
ception may be viewed as a manifestation of 
personality. The perception studies discussed 
above raise questions about denial mechanisms, 
about defensive reluctance to venture response, 
fear of recognizing inadequacy, and fear of 
failure. These interpretations provide clues to 
some of the themes in the literature on per- 
sonality. There are hypothesis suggesting that 
many older people question their abilities, their 



roles, anu their self-worth. Their behavior is 
often characterized by avoidance. One inter- 
pretation of this avoidance is that it wards off 
the possibility of failure, and thus maximizes 
the opportunities for self-acceptance. 

The concept of avoidance, better known as 
disengagement, is probably the most thoroughly 
researched one in the study of personality in 
later life. 25 In its simplest form the concept 
of disengagement asserts that with increasing 
adult age there is an increasing tendency to dis- 
sociate oneself f r orn people and activities. As 
the concep 4 was originally expressed, this dis- 
sociation was a normal ..vent, conceived as the 
inevitable behavioral counterpart of biological 
decline. A controversy developed, not about the 
observation, bit about whether the dissociation 
was normal, inevitable, or desirable. 

There are two questionnaire studies which 
bear on the controversy concerning the normality 
of disengagement, although neither one was 
designed for this purpose. In the first study 
elderly and young adults were asked to make n 
series of decisions, each involving risks. The 
alternative courses available in each decision 
were either to continue with an undesirable but 
tolerable situation, or to take action which if 
successful would remedy it, but if not would 
make the situation worse. The subject was told 
that he could decide to risk action on the basis 
of the likelihood of its success. He could risk 
if there were 9 chances ui 10 that the action 
would succeed (conservative choice), if there 
were 7 chances in 10, 5 chances in 10, 3 chances 
or only 1 chance in 10. The least cautious or 
conservative response was scored I, the next 
3, and so on. The subject was also told that he 
could decide not to risk, regardbss of the like- 
lihood of success (scored 10). 

The older people were more cautious, in 
their decisions than the younger people, and this 
seemed to be an especially reliable result since 
it was seen in a North Carolina population after 
having been first reported in a Massachusetts 
population. 27 When the nature of the cautious- 
ness of the older group was analyzed further, 
it was seen that much of the cautiousness was 
reflected in the decision not to choose the risky 
course of action regardless of the probabilities 
of success (the choice scored as 10), 

Tt was recognized that the decision not 
to risk at all might be qualitatively different 
from the very conservative decision to attempt 
the risk only when the chance of success was 
great, such as 9 out of 10. If (he two types of 
decisions arc qualitatively different, the differ- 
ence lies in the fact that the choice scored as 



9 involves cautious risk behavior, whereas the 
choice scored as 10 involved avoidance. To test 
this, a second study of avoidance was carried 
out replicating the basic features of the first 
study, except that the choice to avoid (a score 
of 10) was not permitted. 28 Decisions involv- 
ing risk were required of all subjects, but the 
wade range of cautiousness or conservativeness 
was retained. The thinking underlying the study 
was that if the older people were truly more 
cautious in the sense that the original studies 
intended, they should choose the least risky 
alternative that is, 9 chances in 10 — now that 
the avoidance alternative was not permitted. 
However, if caution in this sense was not in- 
volved in the original results and avoidance 
behavior was, then old and young should be 
similar in their choices when forced to a deci- 
sion w'here some risk was unavoidable. 

The elderly were not different from the 
young in cautiousness scores when they were 
obliged to make a decision involving risk. The 
two studies taken together showed that when 
given the opportunity, the older subjects simply 
chose to leave the field. It seems possible that 
this type of disengagement reflects a fear of 
failure involving problems of social approval 
and perhaps self-acceptance as easily as it does 
a loss of interest. The elderly subjects did not 
convey disinterest or poor motivatiDn in the 
testing situat ms. Disengagement may best be 
seen as a defensive responsiveness to confron- 
tations with the social forces of life, rather than 
as an unresponsiveness to the impact of the 
environment. 

The two questionnaire studies discussed 
above are not traditional studies of personality. 
The more traditional studies are varied and 
difficult to integrate. The main reason for this 
difficulty is that many different tests have been 
used and these tests have generated different 
lists of personality traits or combinations of 
traits. In general, most of the investigators 
seem to end their studies unimpressed by the 
scope and magnitude of changes with age in 
personality. Yet it is difficult to know what is 
impressive and what is not; for example, a 
typical finding using the Minnesota Multiphasic 
Inventory (MMP1) is that there is a slight ele- 
vation of the D scale score; that is, there is a 
slight but very consistent trend for a higher 
Depression score among the elderly than in the 
young. Less frequently found is a trend tow'ard 
increased Hypochondriasis and Social Intro- 
version scores. What does an elevation in the 
Depression score, especially when slight, tell 
us about the functioning life of older people with 
respect to depressive affect? All that may be 



said at present is that depression seems to be 
seen clinically in old age, especially among the 
aged who are in poor health. 

Constriction is another personality char- 
acteristic of older people which sometimes is 
found. Constriction seems to be prominent in 
the Rorschach protocols; for example, Ames 
reported that older people tend to have few r er 
responses, a decrease in the variety of content 
categories, and an increase in the percentage 
of responses based upon form.- 9 However, in- 
dividual differences w T ere stressed, indicating 
that some elderly people tended to present just 
the reverse of this pattern. 

Perhaps in contradiction to these findings, 
Neugarten, Crotty, and Tobin reported that 
when constriction was seen, it tended to be in 
men under sixty-five years old, and when self- 
doubting was prominent, it was in relatively 
young women. 30 Their results were based upon 
a Thematic Apperception (T.A.V.) type of test 
and an extensive battery of other procedures. 
It would seem, therefore, that the specific pro- 
cedures and the definitions of concepts to w T hich 
these procedures give rise, are important fac- 
tors in describing changes. The authors con- 
cluded that on the whole “personality type was 
independent of age.” 31 

Considering the results of these and other 
studies, one emerges with a picture that is much 
m need of research clrrification. Overall, the 
personality age trends seem small, but they may 
be important, nevertheless. There are conflict- 
ing signs in the literature, but constriction, so- 
cial introversion, self-doubt, depression, and 
withdrawal seem to be characteristics that war- 
rant further test. If these characteristics are 
personality trends in later life, then more at- 
tention to the elderly is required than simply 
trying to improve their performances. In any 
case, it should be remembered that most studies 
have emphasized the slightness of the trends, 
and, more important, all studies have empha- 
sized the large individual differences w f hich 
occur in personality changes with age. 

SUMMARY AND CONCLUSION 

The growth in the number of research pub- 
lications in gerontological psychology is reach- 
ing such proportions that unless more summari- 
zing and integrating textbooks appear soon, the 
literature may get out of hand. The literature 
thus far usually has been based upon cross-sec- 
tional studies. Longitudinal studies are more 
adequate, but they are very costly and time- 
consuming. In addition, longitudinal studies are 
not without methodological problems. They, 



like cross-sectional studies, reflect increas- 
ingly biased samples as one goes up the age 
continuum. The initially less able subjects 
drop out and are not available for later retest. 
A method combining the cross-sectional longitu- 
dinal, and yet another type of group comparison 
was described which is considered the best 
method yet conceived for doing developmental 
research. Unfortunately, it is a very difficult 
method to carry out. 

Intelligence was briefly discussed. The 
observation was that not all functions decline 
with age; of those that do, not all decline at the 
same rate. One of the functions which does de- 
cline with age is the ability to respond quickly 
to environmental events. A controversy has 
arisen about whether this slowing is related to 
cognition. Whether it is related to cognition or 
not, the slowing does limit performance on a 
wide variety of tasks of intelligence and learn 
ing. This limitation in performance is exacer- 
bated if complexity and lack of structure are 
introduced to the task. On the other hand, when 
conditions do not impose time limits, and when 



there is clarity and structure, older people may 
be expected to perform relatively well. What 
may appear superficially to be poor learning 
ability may be partly a difficulty in performing 
quickly enough. 

Much of the apparent learning deficit may 
also be an unwillingness to demonstrate w^hat 
has been learned for fear of being wrong and 
seeming incompetent. A fear of being wrong 
may stem from a loss of confidence in one’s 
ability and in one’s worth. The literature is not 
without its contradictions, but a loss of self- 
confidence is discussed often enough in relation 
to old age to warrant further test. Doubts re- 
garding one's ability and self worth may lead 
to depression, social introversion, and, finally 
withdrawal. 

Individual differences are always prominent. 
When dowmhill trends are seen in old age, most 
often they are slow in developing. There is an 
urgent need for research focusing upon the com- 
pensatory adjustments used by the elderly and 
the teaching techniques and devices able to 
elicit and facilitate such adjustments. 
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TRAINING STRATEGIES AND INDIVIDUAL DIFFERENCES 



Howard H. McFann 



The emphasis of this chapter is on the exam- 
ination of various training strategies and the 
implications of each for handling individual dif- 
ferences. In addition, research findings perti- 
nent to each strategy will be given as well as a 
statement of instructional procedures and tech- 
niques that have been found to be useful, espe 
dally in instructing low-ability rrm. 

Background Information 

The Human Resources Research Or'ani? t 
tion (HumRRO) is an applied research and de- 
velopment activity which was founded in 1951 
when a contract was initiated between the De 
partment of the Army and George W ^hingtor 
University. The mission of HumRRO, then anc 
now, is to conduct studies and research in train 
ing, training devices, motivation, and leadership 
Until July of 1967 HumRRO worked exclusively 
for the Army. Since then the Army contract has 
been modified to permit work for other spon- 
sors both in and out of government, and cur- 
rently HumRRO is engaged in a modest amount 
of diversification. On September 1, 1969, Hum- 
RRO became an independent nonprofit corpora- 
tion. The overall ct’ective of HumRRO is to 
improve human performance, particularly in 
organizational settings, through behavioral and 
social science research, development, and 
consultation. 

To carry out its mission, HumRRO has 
been organized into seven divisions, five ol 
which are located at major military centers 
and two of which are located in the Washington, 
D. C., area along with the central office and 
other technical and administrative supporting 
offices. 

The findings and discussion to be pre- 
sented in this paper focus on the initial indivi- 
dual training of the soldier which occurs in 
Army training centers. These training centers 
conduct a common basic course for all enlisted 
men {Basic Combat Treining) plus Advanced 
Individual Training for the military jobs which 
involve large numbers of men. In addition to 
training men for specific combat jobs such as 
infantry, artillery, and armor, training is given 
for such diverse jobs as clerks, clerk-typists, 




automotive mechanics, vehicle operators, cooks 
and bakers, telephone linemen, radio operators, 
and medical corpsmen. Clearly these courses 
have civilian counterpart occupations. The ob- 
jective of the Army training is to provide the 
man with prerequisite skills and knowledges so 
he can perform effectively on the job. 

In addition to the wide variety of content or 
occupations, the Army trains a highly diverse 
population. The diversity of this population has 
varied over time, both as the result of numbers 
of men needed and changes in policies of en- 
listment and induction standards. The basic 
test employed by the Armed Forces to screen 
for military acceptance or rejection is the 
Armed Forces Qualification Test (AFQT) which 
is regarded as a general measure of train- 
ability for military service. The AFQT is a 
paper and pencil test which contains 100 items. 
They are divided into four equally weighted 
subtests covering verbal, arithmetic, shop 
mechanics or tool recognition, and pattern 
analysis or spatial perception skills. AFQT 
scores are recorded as percentile ranks rang- 
ing from 1 to 100. Thus, if an. inductee receives 
an AFQT score of 80, this means he has done 
better than eighty percent of the population 
tested. From scores on this test inductees are 
classified into “Mental Groups" ranging from 
Mental Group I, reflecting the highest level of 
aptitude, to Mental Group V, the low f est level. 

Table 1 show’s how inductees are classified 
by the AFQT scores. 1 In addition, approximate 
equivalents for the Wechsler Adult Intelligence 
Scale (WAIS) are presented. It should be em- 
phasized, however, that the AFQT score is not 
interpreted in terms of IQ. It is rather to be 
considered as reflecting aptitude, including both 
innate ability and acquired skills and knowledges. 
A more elaborate explanation of the AFQT test 
and its relation to various factors such as geo- 
graphic area, expenditures for education, teach- 
er salaries, and the like has been presented 
elsewhere. 2 

In the past two years a rapid growth of total 
input combined with a Department of Defense 
decision to lower the AFQT standards has re- 
sulted in a large training load characterized by 
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Table 1 



Classification System for Mental Aptitude Categories 



Mental Cotegory 


AFQT Score 


Wechsler JQ 


1 


93 - 100 


123 + 


II 


65 * 92 


107 - 122 


III 


31 - 6^ 


92 - 106 


IV 


10 - 30 


70 - 91 


V 


1 - 9 


69 and below 



Table 2 



Comparison of Characteristics of Hew Standords Men ond Control Group 





New Stondords 
Men 


Contro 1 
Group 


Average Age - years 


20.4 


20.2 


% High school groduotes 


43.3^0 


75.8*o 


Number of school grades 






completed (average) 


10.6 


11.9 


Reading ability - median grade 


6.1 


10.9 


% Reading below 4th grode 


1 4 . 4 % 


ur c 


Arithmetic ability — median 






grode 


6.3 


NA* 



* NA = Not A vai lable 
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a very wide spread of individual ability, rang- 
ing from grade school to college graduate levels. 
Presently, while still admitting large numbers 
of people from Categories I, II, and III, the ser- 
vices have begun taking twenty to twenty-five 
percent of all enlisted accessions from the 
AFQT Category IV. Under the provisions of 
this program about 100,000 annual accessions 
come from the lower range of Category IV, the 
AFQT nercentile scores 10 through 20. 

T.ole 2 presents a profile of some of the 
characteristics of these Project 100,000 men 
and how they compare to a control group, which 
may help to provide a further perspective on 
the training problems facing the Army. 3 The 
control group consists of men selected by each 
service as representative of men accepted un- 
der previous standards. These men were ad- 
ministered tests by the services in April, 1968. 
The data for the Project 100,000 men are based 
upon about 46,000 men tested July, 1967, 
through March, 1968. As can be seen in table 
2, the two groups are quite comparable in 
average age (20.4 and 20.2) but differ substan- 
tially on other factors. Of considerable inter- 
est are the findings that although the average 
number of school grades completed for the 
new accessions men is 10.6 with forty-three 
percent of them high school graduates, their 
median grade reading level is 6.1, with about 
fourteen percent reading below the fourth grade 
level. Also, on an arithmetic computation test 
they score at a 6.3 median grade level. These 
low reading and arithmetic scores are not too 
surprising since two of the AFQT subtests 
measure these same attributes. 

As a result of this diversity of personnel 
input, HumRRO, along with others, was re- 
quested to initiate a series of research studies. 
The goal of these studies is to provide informa- 
tion which will allow the services to effectively 
and efficiently train and utilise as many of the 
lower-aptitude men as possible. The objectives 
of Project 100,000 are not only to assist these 
men to become satisfactory servicemen but also 
to prepare them to be productive when they 
return to civilian life. 

Research on Training Broad 
Spectrum Aptitude Levels 

Reseatch in HumRRO’s Monterey laboratory 
is concerned with the complete spectrum of ap- 
titudes with an emphasis on the lower-aptitude 
men. Key questions that require answering are 
(1) the extent to which the AFQT scores are 
related to the acquisition and performance of 
skills and knowledges, and (2) if they are re- 
td 




lated, which techniques and procedures wall al- 
low for efficient and effective training of men 
at all aptitude levels. 

Since ample evidence exists to show that 
aptitude differences do relate meaningfully to 
learning and performance in training, the ques- 
tion is what can be done to cope with these dif- 
ferences? What can be done to handle individual 
differences in instructional systems is to a 
considerable extent dependent upon the train- 
ing or educational strategy employed. Four 
strategies which appear to have quite different 
implications for handling individual differences 
and for ease of management are presented in 
table 3. Fixed curriculum refers to a situation 
where content, organization, and the instruc- 
tional mode are fixed. Variable curriculum im- 
plies the possibility of variation in content, 
organization, or instructional mode. Fixed and 
variable time refers to whether the instructional 
program requires all students to spend a fixed 
amount of time in the program or whether they 
can spend varying amounts of time. Fixed stand- 
ard refers to the condition which requires each 
student to achieve a specified minimum level 
of proficiency before graduating from the course. 
Variable standard allows for the student to go 
beyond a minimum level of proficiency. All of 
these strategies are based upon the assumption 
that the objectives of the course or program 
are the same for all students. Although table 3 
presents a framework with considerable simi- 
larity to Cronbach's mode), the writer believes 
this approach is from a sufficiently different 
perspective to be of some use. 4 



Training Strategies I and II 

The first strategy refers to a fixed curri- 
culum and fixed training. Students enter together, 
receive a standard program of instruction, ar d 
finish together. Administratively, this single 
fixed track strategy is appealing; but the only 
tir.'o it could work efficiently is when prior se- 
lection insured a homogeneous input and meth- 
ods and media of instruction were tf’Jored to 
the group — which rarely, if ever, happens. In 
the military, formal selection procedures are 
based upon aptitudes, abilities, prior experi- 
ence, and schooling to allow for a narrowing of 
the input. Nevertheless, based upon data such 
as previously discussed, it is apparent wide 
differences in entry-level skills and ability do 
exist. In short, this lock step training strategy 
ignores individual differences. 

Generally, Army training has been all ged 
to fit this first strategy. In fact, however, the 
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Table 3 

Training Strategies 



Curriculum 


Time 


Standard 


1 p ixed 


Fixed 


Va ricbl e 


11 Fixed 


Variabl e 


F i xed or Variabl e 


IN Variable 


Fixed 


Variable 


IV Variable 


Var iobl e 


Fixed or Variable 



training has been more similar to the second 
strategy of fixed treatment or curriculum with 
variable time — everybody enters together, re* 
ceives the same instruction, but not all make it 
through ihp course the first time. Some men are 
‘'washed* back" or recycled and generally re* 
ceive the same instruction as they did the first 
time. Experience in training shows that even- 
tually most trainees do make it through a course 
with this strategy at least to meet minimal 
goals. However, data such as that provided in a 
study by Baker et aJ. raise the question of the 
efficacy of such a strategy. 5 In this study of 
Armor Advanced Individual Training training 
time for major blocks of instruction were 
varied with training content and procedure 
held constant. Among the several findings in 
this study relating aptitude and learning, it 
was found: (1) for each level of aptitude in gen* 
eral, as the amount of training time was in- 
creased, there w w » a corresponding increase in 
the percentage of test items answered correctly; 

(2) except in two of eighteen skill areas high- 
aptitude trainees were superior to medium- 
aptitude trainees, and the medium-aptitude 
subjects were superior to low-aptitude trainees 
at every level of instruction time (half, stand- 
ard, twice, and three times the standard); 

(3) for most of the skill areas high-aptitude 
trainees who received instruction for half the 
standard period were superior or equal to 
medium-aptitude trainees who received in- 
struction for twice the standard period and to 
low-aptitude trainees who received training 
for three times the standard period; and (4) in 
four major areas the low-aptitude group failed 
to aoouire anything approaching an adequate 
degree of skills. 



o 




An important difference between Army 
training and public education is that the Army 
must utilize the products of its instructional 
system. The setting of minimum standards for 
graduation and insuring that these standards 
are met is mandatory. Thus, much of the Army 
training has involved a fixed standard. 

It appears that in public education, espe- 
cially in elementary and secondary schools, 
often a variable standard has been employed, 
which would account for the finding that high 
school graduates are reading at markedly dif- 
ferent levels with thirty percent of them per- 
forming at or below the fourth grade level. An 
article by Bloom advocates and presents an ex- 
cellent discussion of what would be implied for 
education and for the student if fixed s.andards 
were established and required. 6 

In both training strategies I and II, a key 
problem is where to gear the instruction. If it 
is at the low-ability level, then the more capable 
are held back with resultant boredom, poor atti- 
tudes, and lack of efficiency of instruction. In- 
struction geared at the upper level results in 
either unduly high attrition rates, or many who 
are moved forward with out mastering thematerial 

Since the graduate must be employed by the 
institution, in Army training, much of the in- 
struction has been designed for the middle to 
lower trainee with the general view that the 
higher-aptitude tiainee will get the training 
anyway. The public schools generally seem to 
have had a tendency to place more emphasis on 
instruction for the middle- and upper-ability 
student 

One use of tiaining strategy II which ac- 
commodates to differences in ability and allows 
for a fixii standard would be to gear the instruc- 
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tion to the low-aptitude student and allow the 
more able student to move through the program 
at his own rate. 

Training strategies III and IV, which involve 
variable curriculum, are the only strategies 
which can effectively take into account indivi- 
dual differences. A summary of some research 
which emphasizes the necessity for accommo 
dating individual differences in training is pre- 
sented before examination of these strategies. 

Research on Aptitude and the 
Acquisition of Skills and Knowledges 

A laboratory study by Fox et al. had as its 
purpose the clarification of the relationship be- 
tween aptitude level and the acquisition of mili- 
tary skills and knowledges i" a variety of tasks 
which varied in complexity. 7 Subjects for this 
study were 183 newly inducted Army recruits 
who were divided into three maximally distant 
aptitude groups on the basis of their AFQT 
scores: High Aptitude*AFQT scores 90 to 99; 
Middle Aptitude-AFQT scores 45 to 55; and 
Low Aptitude-AFQT scores 10 to 21. Supple- 
mentary psychometric data {Army Classifica- 
tion Battery and Aptitude Area Scores) ana 
ir^ormation on scholastic achievement (years 
of school completed, reading, and elementary 
arithmetic proficiency) showed the high-aptitude 
subjects to be decidedly superior to the low- 
aptitude subjects, with middle-aptitude groups 
scoring in an intermediate range. Although 
sixty-one per cent of the low AFQT group were 
high-school graduates, reading scores for low- 
aptitude subjects spread evenly across the 
grade levels from zero .to eleven, whereas 
seventy-one per cent of the middle group, and 
ninety-four of the high-aptitude group read at 
or above the twelfth grade level. Since a major 
focus of the study was on the marginal-aptitude 
trainee, instructional methods were selected 
to maximize the low-aptitude recruit’s oppor- 
tunity to learn. The selection of instructional 
methods and learning conditions was establish- 
ed, on a judgmental basis, without regard for 
considerations of cost and effort, or for effi- 
cacy for the middle- and high-aptitude groups. 

Where practical, training was automated 
to insure standardization and clarity, using 
audiovisual presentation including slides and 
video tapes. Verbal instruction was given in 
simple language with ample pictorial examples. 
All Irainit^ was conducted individually with an 
instructor present to give prompts, answer 
questions, and to provide immediate knowledge 
of results after each response. Material was 
presented in the smallest possible integral 
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segments. Instruction was repeated or reviwed, 
as appropriate, and practice was provided on 
each trial. In short, training procedures were 
tailored, within the experimenters’ judgment, 
to give the lower-aptitude trainee the best op- 
portunity to leam. 

Tasks were selected on the basis of two 
criteria. The first was that the tasks should 
have elements in common with the skills and 
knowledges required in a large number of mili- 
tary jobs. The second criterion was that tasks 
should be representative of several levels of 
complexity. Gagne’s taxonomy of learning types 
served as a general guide for discriminating 
complexity differences among tasks. 8 Gagne 
defined eight different types of learning which 
he outlined hierarchically from classical con- 
ditioning to problem solving. The first criterion, 
that tasks be representative of practical mili- 
tary jobs, prevented the selection of pure exam- 
ples of each learning type as proposed by Gagne. 
The task battery, as finally selected, was com- 
posed of eight tasks which were roughly placed 
along a dimension of complexity as outlined in 
table 4. 

The simple and choice monitoring tasks are 
considered to be representative of a number of 
visual surveillance or watchkeeping activities — 
tasks requiring detecting and reacting to a sig- 
nal such as is required for switchboard opera- 
tors and control panel monitors. In the simple 
monitoring task the subject’s job was to press 
a response lever when a light appeared on a 
display panel. The choice monitoring task re- 
quired responding to one of four possible lights 
by pressing one of four corresponding lever. 
The importance of speed in responding was 
emphasized. As expected, all subjects were 
immediately able to do the task. However, the 
results indicated that at this relatively simple 
level of task complexity, low-aptitude subjects 
displayed poorer performance when compared 
to higher-aptitude subjects. The low-aptitude 
subjects were on the average slower to respond, 
more variable in their responses, and were not 
as accurate as those of higher aptitude. 

At the next level of complexity, which re- 
quired the learning of fixed procedures, the 
rifle assembly and disassembly tasks are 
elements in common with a variety of tasks 
performed in many jobs. In addition to assembly 
and disassembly procedures, fixed-procedure 
motor tasks are involved in the maintenance of 
the whole spectrum of mechanical and electro- 
nic equipment. In these tasks the job was to 
assemble or disassemble the rifle in a pre- 
scribed seven-step sequence. The individual 



Table 4 



Ordering of Tasks Along a Dimension of Complexity 



Description of Learning 
Requirements 


Tosk 




Requires learning of concepts 


Position Plotting 


jj ond principles and their oppli- 




1 


I 




E 






(j cation in a problem situation 




/ 


\ 






Requires multiple di scrimination s 


Mop Symbols 




of words and symbols (serials or 


Phonetic Alphobet 




poired-a ssociote learning) 






Requires learning of fixed pro- 


Equipment Preparation 




cedures; either verbal or motor 


(verbal procedure) 




(chaining of verbal or motor 


Rifle Assembly 




responses) 


Rifle Disassembly 


V 

a 
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trainee was led, step-by-step, through correct 
assembly or disassembly procedure via a video 
tape presentation. After each step in the se* 
quence the tape was stopped and the trainee 
was allowed to complete the same step on a 
rifle provided him. On each trial he received 
prompts and direct assistance if required. Sub- 
jects were told to work as rapidly as possible 
but not to skip steps or attempt shortcut pro- 
cedures. Clearly, all of the trainees could per- 
form the task, but there were differences on the 
initial ability to profit from instruction, the 
amount of help needed, and the final level of 
performance. All differences were in favor of 
the high-aptitude group. Low-aptitude subjects 
on the average took about twice as long as 
high-aptitude subjects to reach minimum pro- 
ficiency, and required more than twice as much 
individualized help or prompts. There was con- 
siderable variability in individual performance 
within aptitude groups. Some low-aptitude train- 
ees reached criterion with a minimum of train- 
ing and practice, while others did not reach 
criterion on the last recorded trial. On the 
other hand, there were a few high-aptitude 
trainees who did relatively poorly on the tasks 
although all reached criterion. 

At about the same level of complexity as 
the above tasks was the equipment preparation 
task which is a fixed-procedure task but em- 
phasizes learning a series of verbal responses. 
Verbal procedure tasks are found in many jobs 
that require the use of checklists in the setting 
up and operation of equipment such as checkout 
procedures and trouble shooting. The equipment 
task consisted of a thirty-four-step procedure 
for launching a missile. The subject was trained 
to perform the thirty -four- step sequence on a 
specially designed training device which simu- 
lated a missile control panel. The proper pro- 
cedure was demonstrated by an instructor and 
the trainee was provided a written checklist. 
The instructor provided verbal and spatial 
prompts throughout training. On the average, 
low-aptitude subjects required six times as 
many prompts, threp times as many trials, and 
at least four times as long as high-aptitude 
subjects to reach criterion. The low-aptitude 
group showed the greatest variability, with 
some subjects of this group mastering the task 
early while others never did. 

The learning of map symbols and the in- 
ternational phonetic alphabet are examples of 
tasks involving multiple discriminations. The 
map symbols task required learning to asso- 
ciate words with symbols, while the phonetic 
alphabet task required learning to associate 
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letters of the alphabet with corresponding phon- 
etic equivalents. Examples of other Vasks of 
this nature included learning cooking times 
and temperatures for food, nomenclature of the 
names of parts of equipment, and color coding. 

The map sumbols task consisted of learn- 
ing twenty-six commonly used map symbols. 
Each symbol appeared on a five inch by eight 
inch study card with its appropriate name, and 
an artist’s representation of the thing, place, 
or event which was represented by the symbol. 
The trainee used the cards for a series of study 
periods. After each study period the trainee 
was asked to identify the twenty-six symbols. 
The instructor indicated the errors made as 
well as telling the trainee the correct respon- 
ses. The general procedure for the phonetic 
alphabet task followed that of the map symbols 
task. All of the twenty-six letters and their 
corresponding equivalents were printed on a 
single card in correct alphabetical sequence, 
for example, A-ALFA, B-BRAVO. 

On the map symbols task the low AFQT 
group took about twice as many trials to attain 
criterion as the middle AFQT group, and the 
middle AFQT group took about twice as many 
trials to reach criterion as the high AFQT 
group. Again, the low-aptitude group exhibited 
much greater variability than the other twe 
groups. 

On the phonetic alphabet task the perform- 
ance of the high and middle group were much 
alike and both differed markedly from that of 
the low-aptitude group. Although not as pro- 
nounced as in the map symbols task, wider 
variability was again evidenced within the AFQT 
gro^p. 

The final task used in the study by Fox et al. 
was the position plotting task which represents 
the highest level of complexity included in the 
task battery. This task involved the learning of 
concepts and the application of principles. The 
recruit had to learn the concepts of range and 
bearing and apply them in an intersection prob- 
lem to plot the position of an aircraft. Instruc- 
tion in plotting techniques was given using a co- 
ordinated audio tape 35-mm slide program 
presented via closed circuit television. An in- 
structor was present to provide help, di r ect 
practice, and answer questions throughout the 
instructional sequence. At the conclusion of 
training subjects were required to make ten 
plots on a plotting board. After each plot the 
instructor provided immediate knowledge of re- 
sults by indicating the correct point of inter- 
section. 

The high* and middle-aptitude groups had 
little trouble mastering the plotting task. How- 
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ever, one-fourth of the low AFQT subjects had 
not obtained criterion performance by the end 
of training. Again, considerably greater varia- 
bility was displayed by the low-aptitude group. 

The results of this laboratory study are 
consistent in demonstrating large and meaning- 
ful differences among recruits of differing apti- 
tude levels on these tasks which vary in com- 
plexity. In general, the low-aptitude subjects 
were slower to respond, required more train- 
ing time, needed more guidance and repetition 
of instruction, and had a wider variation in 
performance than the middle- and high-aptitude 
subjects. It is not surprising to Find that differ- 
ences existed among aptitude level groups on 
the more complex tasks. What is significant is 
the magnitude of the differences observed and 
the fact that they occurred at all levels of task 
complexity, including very simple tasks, and 
on both verbal and motor skill tasks. 

On almost every task there were a few low- 
aptitude subjects whose performance matched 
that of the middle and high groups; similarly, 
on almost every task there were some low- 
aptitude subjects who failed to reach criterion, 
and the remainder were spread over a wide 
range of performance. Apparently men identified 
by the AFQT low mental category are not all 
slow learners; they constitute a heterogeneous 
group. Factors such as language difficulty, 
motivation, and test-taking experience could 
all contribute to an individual’s receiving a 
low AFQT score, but analysis shows that such 
factors do not account for the group differences 
obtained in the present studies- An important 
problem to be solved in military training lies 
in the differential sorting cf low-aptitude per- 
sonnel. There is a need for devising ways to 
identify the faster learners and their areas of 
promise among those who enter service labeled 
as low aptitude. 

As a further check on the relationship be- 
tween aptitude as measured by the AFQT and 
by performance, follow-up data on these same 
subjects’ performance we^e obtained. At the 
end of the first eight weeks of training . '1 
trainees are giv^en an end-oficycle test over 
those subjects covered in Basic Training. These 
tests, which cover both motor skill and cognitive 
material, are part performance end part writ- 
ten. The Basic Training program is highly 
standardized and focused toward the level of the 
lower- aptitude recruit. There is considerable 
effort both in the forma! program and in re- 
medial training to insure that almost all men 
meet graduation standards by passing the test. 
Although all subjects passed the tests, the find- 
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ings are con t in showing the generally 
superior performance of the high-aptitude group, 
with the greatest differences appearing in those 
tests covering cognitive material. As one moves 
away from Basic Training and into the more ad- 
vanced and technical courses, such as are given 
ir. combat support training and involving greater 
cognitive demands, these differences in aptitude 
become more noticeable. 9 

These data on performance are quite com- 
patible with a previous HumRRO study by Gof- 
fard et al. which investigated in more detail f he 
Category IV (AFQT scores of 10 to 30) person- 
nel in Basic Training. As might be expected, 
they found that “in comparison with the men in 
other categories, more of the Category IV came 
from poor social, economic, educational, and 
occupational backgrounds and had low expecta- 
tions and aspirations for their future life.” 10 

Training Strategies III and IV 

Training strategies III and IV do allow for 
the handling of individual differences. The third 
training strategy of variable curriculum and 
fixed time has the administrative nicety of a 
fixed termination for all students but almost 
certainly would result in some form of group- 
ing and variable output. Theoretically at least, 
the instruction^ approach can be geared to the 
appropriate ability level to insure efficient mas- 
tery of material. If the decision is to invest a 
given amount of time for instruction, then it 
follows that with this strategy the outcome will 
be a variation in amount mastered. It is diffi- 
cult to conceive of an instructional approach 
that will oveicome the marked differences in 
ability and past experiences observed in the 
HumRRO data, especially when the input con- 
sists of adults. One of the key requirements of 
this sti itegy is the employment of a selection 
procedure which places individuals into the 
proper instructional group. That this is ex- 
tremely difficult is evidenced by many studies, 
including the one previous '.y summarized, where 
there was marked variability in acquisition and 
level of performance of those trainees with low 
AFQT scores. One of the prime dangers with 
this strategy is that with fixed time it is diffi- 
cult to allow for movements of rtudents from 
one group to another depending upon perform- 
ance. Also, students can easily be pegged or 
categorized as members of a particular group 
with expectations which may have a negative 
effect on performance. 11 

The last training strategy to be discussed 
(Strategy IV) is one that calls for variable cur- 
riculum and variable time. This strategy al- 



lows for the greatest attention to the individual 
and calls for the most complex management. 
However, it also allows for the most flexibility — 
flexibility not only in the instructional system 
but also in handling the output of the course. If 
desired, the student can continue a program 
until he reaches a given level of mastery, or 
students can be allowed to reach different levels 
or capabilities, and, if necessary, remedial in* 
struction can be introduced. An example is the 
literacy training in the military which has as 
its goal increasing literacy and arithmetic 
skills of students before they start formal 
training. Students can be moved ahead or allow- 
ed to skip certain sections since they already 
possess the prerequisite skills and knowledges. 

Overall, it appears that training strategies 
I and II, which have a fixed curriculum, cannot 
truly handle individual differences, although 
strategy II with variable time does allow for 
different rates of progress. Training strategies 
III and IV do allow for handling individual dif- 
ferences, with only training strategy IV allow- 
ing for both variable curriculum rnd the option 
of either having the same standard for all, or 
having different standards. 

The Systems Approach 

Regardless of the strategy adopted, the 
course content, the characteristics of the stu- 
dent, and the method or media employed, there 
are certain requirements which are common 
and essential to efficient and effective instruc- 
tion. These requirements, which are derived 
from training technology, are: 

1. Terminal course objectives must be deter- 
mine and explicitly stated. Such state- 
ments involve what it is that the learner 
should be able to do following instruction, 
including the conditions under which he 
should be able to perform and the standard 
or level of performance required. 

2. These terminal objectives must be analyzed 
or broken down into enabling objectives. 
In most summary forms this involves de- 
termining the prerequisite skills and know- 
ledges that the learner must possess to be 
able to perform satisfactorily the terminal 
objectives which constitute the goal of the 
course. 

3. Performance evaluation must be incor- 
porated to include assessment at entry 
level, during progression through the 
course, and of final proficiency. The dis- 
crepancy between entry level capability 
and terminal objectives defines to a great 



extent what must be accomplished in in- 
struction. Assessment of progression 
through the course reflects mastery of the 
enabling objectives while assessment of 
final proficiency reflects the success of 
the instructional program. 

The value of and procedures for accom- 
plishing the above steps are well established 
both for training and education. 12 Many readers 
will recognize that these statements constitute 
components of what has come to be called the 
systems approach to the development of in- 
struction. Recently the Army published a direc- 
tive Requiring that all Army courses underge 
this systems engineering. 13 An excellent pre- 
sentation and discussion of various systems 
approaches, including the HumRRO one, can 
be found in a recent publication. 14 

ADDITIONAL TRAINING VARIABLES 

Carrying out the above steps to a consid- 
erable extent defines course objectives and 
assures adequate measurement. Of equal im- 
portance in course construction is the selection 
of course content, instructional method or me- 
dia, and management decisions on incentive sys- 
tems and use of resources. The present HumRRO 
research effort is focused not only on these 
factors or variables and how they relate to 
each other and interact with ability or aptitude, 
but also on putting findings into practice through 
the testing of developed courses of instruction 
in operational settings. The goal is to provide 
information which will allow for effective train- 
ing across all aptitude levels. Much research 
has been done, both military and civilian, and 
much more information is needed before the 
goal of taking into account individual differ- 
ences cun be fully achieved. Although final an- 
swers are not available on how to cope fully 
with individual differences, some information 
does exist which has implications especially 
for instructing low-aptitude men. 

The Functional Context Approach 

One such implication concerns the structur- 
ing and sequencing of content. 15 As might be 
expected, the higher-ap*itude man is able to 
cope with a variety of organizations and sequen- 
cing of material. Although structure is helpful 
to the high-ability man, it becomes much more 
so for the low-ability person. Apparently, a 
cardinal aspect of this structuring concerns 
establishing the :*elevance or meaningfulness 
of the material to be learned. The establish- 
ment of such relationships is an essential char* 



acteristic of what has come to be labeled the 
“principle of functional context.” 16 Numerous 
studies in such diverse courses as electronics 
training and the training of medical corpsmen 
have demonstrated the efficacy of applying this 
principle. 17 The principle of functional context 
is a general method of sequencing and struc- 
turihg training content so that the intended use 
of new instructional material is established for 
the learner prior to the introduction of the 
material itself. The principle follows simply 
from tie fact that one learns and retains best 
those new things one can somehow tie in with 
the already known. Ancillary to the principle of 
functional context are certain working rules: 
(1) go from the concrete to the abstract; (2) go 
from the specific to the general; (3) go from 
practice to theory; and (4) go from the familiar 
to the unfamiliar. The nature of the objective 
to be attained will determine which formulation 
is chosen. 

What the principle of functional context 
implies is that one arranges and integrates 
subject matter material into meaningful tasks. 
It is task or problem oriented rather than sub 
ject oriented. Some examples may help to claf- 
ify this matter. In electronics maintenance 
courses instead of initially presenting a block 
of instruction on the theory of electricity fol- 
lowed by a block* on thj use of test equipment 
and then starting on trouble shooting or main 
tenance procedures, trainers start with a job- 
related problem or task to be done and teach 
only the relevant theory and test equipment re- 
quired for the solution of the problem. 18 All of 
the theory, use of tools, and test equipment are 
taught in the context of meaningful tasks so that 
their relevance is apparent to the learner. At 
l he iime research was initiated on the train- 
ing of medical corpsmen, instruction consisted 
of blocks of fundamental subjects taught in pro- 
gressive sequence. 19 There were blocks of 
instruction in anatomy and physiology, common 
drugs and their Vses, medical symptomatology, 
basic medical treatment, and so on. These sub- 
jects were taught in relative isolation and out 
of the context in which they were to be applied 
to the solution of a specific medical problem. 
Knowledges and skills necessary to the solution 
of a medical problem were frequently forgotten 
by the time they were to b 3 applied. In the func- 
tional context approach the material to be 
learned was organized around the job require- 
ments. Instruction was developed around what 
occurs to a wounded or sick man successively 
and what the medical corpsman must know and 
do to care for him properly. Tying the instruc- 
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tional sequence to medical techniques meant 
teaching essential knowledge and skill in con- 
junction with these techniques. 

Evaluation 

Consistent with the functional context ap- 
proach is the requirement that the mastering of 
material be emphasized throughout the instruc- 
tional program. 20 This requirement is based 
on the premise that learning is cumulative and 
the learning of new material is directly depen- 
dent upon the student’s mastery of prerequisite 
knowledges and skills. Further, it implies that 
careful assessment should be made as to where 
the lea* uer is at each stage of the learning pro- 
cess from entry level on. 

Methods 

Another area which deserves attention is 
methods and media. 21 One thing appears clear 
— for efficient learning to occur, the learner 
should be an active participant and provision 
needs be made to insure that he obtains infor- 
mation on how he is doing. Such is inherent in 
programmed instruction, computer-assisted 
instruction, individually prescribed instruction, 
and practical exercise training. Historically, at 
5 cust in military training, lectures, films, and 
educational television were often lacking in these 
characteristics. Fortunately, many of these 
lacks have been overcome as these media have 
been modified to insure learner participation 
and feedback an progress, both to the learner 
and the instructor. To a considerable extent 
this has involved instituting procedures for 
assessment after fewer teaching points and a 
combination of media such £? short segments 
of video integrated with practical exercises. 22 

A second point under media concerns the 
selection of the appropriate media for the stu-. 
dent. A series of studies at the HumRRO lab- 
oratory were initiated to determine the relative 
effectiveness of reading and listening as means 
for instructing men of different mental aptitude 
levels. 23 The results indicated that (1) with 
medium- and low-aptitude groups, . -tening 
was as effective as reading in promoting the 
recall of factual information of single and of 
complex passages; (2) for both reading and 
listening, the performance of the medium- 
aptitude group surpassed that of the low-aptitude 
group; (3) some individuals in both aptitude 
groups did better by reading than by listening, 
and vice versa. The obvious implications are: 
(1) that where feasible, reading and listening 
materials should be made available to students 
so the student can choose the media most 
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appropriate for him; and (2) the level of diffi- 
culty of content must he matched to the student 
for both reading and listening. 

A final point on media concerns simula- 
tion and simulators. The general use of simu- 
lated training and the use of simulated situations 
has mushroomed in the last twenty years, and 
all indications are that greater attention and 
use of simulation will occur in the future. A 
basic question exists as to the requirements for 
fidelity in the simulator or simulation — to 
what extent must it resemble the actual equip- 
ment or situation for learning to occur? 

A eonsiderable body of literature exists 
which ^hows that fo;r fixed procedural tasks, 
ranging from starting and stopping a helicop- 
ter to controlling course and depth in a sub- 
marine, fidelity is relatively unimportant in 
the training device. In a series of studies at the 
HumRRO laboratory Grimsley investigated the 
interaction of aptitude level and fidelity of the 
training device on learning and retention. 24 The 
task consisted of learning a fixed procedure in- 
volving a ninety-two-step procedure for potting 
a control panel into operation. AFQT Category 
IV and Non-Category IV personnel were trained 
on one of three panels differing in appearance 
and/or functional fidelity. They were released 
four and six weeks after initial training. The 
high-fidelity panel was a physical duplication 
of the actual equipment, in which everything 
worked — ail lights, meters, the intercom, and 
so on; the second panel was identical to the 
first except that there was no electrical power; 
and the third, or low-fidelity device, was a 
full-size artist’s representation (in color) of 
the high-fidelity panel. 

Consistent with other studies, Grimsley 
found that for the medium- and high-ability 
trainee, the fidelity of the training device used 
for fixed procedural tasks could be very lew 
with no adverse effect on the time needed for 
training, the level of pi >ficiency, the amount 
remembered over time, or the time needed for 
retraining. However, fidelity of the training de- 
vice was found to be most important in the 
training of low-ability personnel. For the lo v- 
ability group the higher the fidelity of the de- 
vice. the greater the proficiency achieved and 
the less time required for training. Marked vari- 
ability of the low f -aptitude group also was ob- 
served in this study. For procedural tasks simple, 
low-cost pictures or drawings can be substituted 
for actual equipment or expensive simulators 
or modeb when instructing average* or high- 
ability personnel. Caution should be employed 
on practicing such economy when training low 
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ability men and should be weighed against in- 
creased cost in needed time to learn and the 
amount mastered. 

Motivating 

A final area, which will be mentioned briefly, 
concerns motivation and incentives or rewards. 
The high-ability man comes to the learning 
situation with a history of general learning suc- 
cess and usually has considerable confidence 
in his ability to learn new things. The low- 
aptitude man often has had a history of non- 
success in learning which has done little for 
his self-concept and has resulted in a general 
desire to avoid situations that appear like 
schooling. 25 

Training for the high-ability men may 
consist of presenting him with a challenging 
situation coupled with appropriate incentives 
and allowing him to move forward at his own 
pace. For the 1 owe* -ability man, the question 
is more how T to get him started and how to 
make provision for early and consistent suc- 
cess so that he can gain self-confidence. 

In the past few years behavioral scientists 
have learned much about procedures to be used 
in the application of incentives or rewards. 2 * 
Procedures have been concerned both with the 
schedule of application as well as the nature 
of the incentive, that is, what incentive can be 
given to increase motivation and desire to 
learn. Incentives often used are recognition, 
material rewards, and autonomy. Clearly, if 
the incentive is positive, more learning occurs. 
Further, some evidence suggests that in train- 
ing for the more able man, the payoff can be 
at a more distant time — he values autonomy. 
However, for the lower-ability man, the payoff 
is more efficacious if it is of a more imme- 
diate nature and of a material sort. 

Summary 

1. HumRROhas found marked and meaningful 
differences among ability groups as de- 
fined by the AF'QT, in learning and per- 
formance and has concluded that these 
differences should be taken into account 
in training. 

2. Four training strategies for handling indi- 
vidual differences were examined. The 
fourth and most flexible strategy appears 
the most desirable in that it allows for 
variable curriculum, time, and either a 
fixed or variable standard. 

3. Three prerequisites have boon found essen- 
tial to efficient and effective instructional 



development regardless of the strategy 
employed. They are: (a) a statement of 
terminal objectives; (2) a statement of 
enabling objectives; and (3) the establish- 
ment of performance assessment or eval- 
uation. 

4- HumRRO has found that functional context 
and progressive mastery are essential 
components of effective course presenta- 
tion to low-aptitude students. 



5* Provision for student participation and 
student knowledge of progress coupled 
vith highly individualized media and tech- 
niques are especially important in in- 
structing men of lower ability. 

6. The writer is convinced that the problems 
that HumRRO is coping with and the solu- 
tions acnieved in individualizing At my 
training have direct application to civilian 
education and training. 



NOTES 



1. Thomas G. Sticht, “Some Relationships of 
Mental Aptitude, Reading Ability, and Listening 
Ability Using Normal and Time-Compressed 
Speech,” Journal of Communication 18, no. 3 
(1958): 243-258. 

2. Richard de Neufville and Caryl Conner, 
“How Good Are Our Schools?” American Educa- 
tion 2, no. 9 (1966): 1-9. 

3. "Project One Hundred Thousand,” Com - 
mandcr’s Digest , December, 1968, p. 7. 

4. I^ee J. Cronbach, “How Can Instruction Be 
Adapted to Individual Differences?’ 1 in Learning 
and Individual Differences, ed. Robert M. Gagne 
(Columbus, Ohio: Charles E. Merrill, 1967), 
pp. 23-44. 

5. Robert A. Baker, Boyd L. Mathers, and 
Eugene G. Roach, The Effects of Increasing and 
Decreasing Training Time on Proficiency in 
The Critical Armor Skills , Technical Report, 
no. 55 (Alexandria, Va.: Human Resources Re- 
search Office, 1959). 

6. Benjamin S. Bloom, “Learning for Mastery,” 
UCLA Evaluation Comment 1, no. 2 (1968). 

7. Wayne L. Fox, John E. Taylor, and John S* 
Caylor, Aptitude Level and the Acquisition of 
Skills and Knowledges in a Variety of Military 
Training Tasks , Technical Report, no. 6 (Pre- 
sidio of Monterey, Calif.: Human Resources 
Research Office, Division No. 3, 1969). 

n 

8. Robert M. Gagne, The Conditions of Learn- 
ing (New York: Holt, Rinehart, and Winston, 
1965). 

9. Ernest K. Montague and Morris Showel, A 
Review of Combat Support Training, Technical 
Report, no. 19 (Presidio of Monterey, Calif., 
Human Resources Research Organization, Divi- 
sion No. 3, 1969). 

10. S. JameB Goffard, Morris Showel, and Hilton 
M. Bialek, A Study of Category IV Personnel in 



Basic Training, Technical Report, no. 2 (Pre- 
sidio of Monterey, Calif.: Human Resources Re- 
search Office, Division No. 3, 1966), p. V. 

11. “Institutionalization of Expectancy: A Spe- 
cial Issue,” Urban Review 3, no. 1 (1968). 

12. Harry L. Anunerman, and William H. Mel- 
ching, The Derivation, Analysis, and Classifi- 
cation of Instructional Objectives, Technical 
Report, no. 4 (Ft. Bliss, Texas: Human Resources 
Research Office, Division No. 5, 1966); Meredith 
P. Crawford, “Concepts of Training,” in Psy- 
chological Principles in System Development , ed. 
Robert M. Gagne (New York: Holt, Rinehard, and 
Winston, 1962); Jack V. Edling et. al., “The Con- 
tribution of Behavioral Science to Instructional 
Technology,” in Teaching Research (Monmouth, 
Oreg.: Oregon State System of Higher Education, 
1968): Robert F. Mager, Preparing Objectives 
for Programmed Instruction (San Francisco: 
Pearon, 1962); Robert G. Smith, Jr., The De- 
velopment of Training Objectives. Research 
Bulletin, no. 11 (Alexandria, Va,: Human Re- 
sources Research Office, 1964). 

13. “Training,” U.S. Contincnfal Army Com* 
mand CONARC Regulation 350-100-1 (Port Mon- 
roe: Headquarters United States Continental Army 
Command, 1968). 

14. Edling, “The Contribution of B.- .avioral 
Science.” 

15. Leslie J. Briggs, Sequencing of Instruction 
in Relation to Hierarchies of Competence (Pitts- 
burg. Pa.: American Institutes for Research, 
1968). 

16. Harry A. Shoemaker, “The Functional 
Context Method of Instruction,” IRE Transac- 
tions on Education E-3, no. 2(1960). 

17. George H. Brown, Wesley C. Zaynor, Alvin 
J. Bernstein, and Harry A. Shoemaker. Develop- 
ment and Evaluation of an Improved Field Re- 
pair Course, Technical Rep< rt, no. 58 (Alexan- 
dria, Va.: Human Resources Research Office, 



88 , 



1959); Joseph S. Ward, Nelson I. Fooks, Richard 
P. Kern, Robert D. McDonald, Development and 
Test of an Integrated Basic Combat/ Advanced 
Individual Training Program for Medical Corps- 
men (MOS 91A10), Technical Report (Presidio 
of Monterey, Calif.: Human Resources Research 
Office, Division No. 3, 1968), in press. 

18. Brown et al., An Improved Field Repair 
Course. 

19. Ward et al., Training Program for Medical 
Corpsmen. 

20. Bloom, “Learning for Mastery;” Crawford, 
System Development. 

21. Leslie J. Briggs, Instructional Media( Pitts- 
burgh, Pa.: American InstitutesforResearch, 1967). 

22. Ward et al., Training Program for Medical 
Corpsmen. 

23. Sticht, “Some Relationships of Mental 
Aptitud?.” 

24. Douglas L. Grimsley, Acquisition, Retention , 



and Retraining: Training Category IV Personne 
with Low Fidelity Devices , Technical Report 
no. 12 (Presidio of Monterey, Calif.: Human Re* 
sources Research Office, Division No. 3, 1969). 

25. Goffard, Showel, and Bialek, A Study of 
Category IV Personnal. 

26. Mark L. Berman, “Improving the Perform- 
ance of Culturally Disadvantaged Adult Students/' 
Educational Technology 8, no. 20 (1968): 16-18; 
Barrie Cassileth, Review of Concepts and Litera- 
ture on Contingency Management, Professional 

Paper, no. 15 (Ft Knox, Ky.; Human Resources 
Research Office, 1968); Howard M. Cohen, “Edu- 
cational Therapy: The Design of Learning En- 
vironments," in Research for Psychotherapy, 
vol. 3, ed. John L. Shlien (Washington, *0.0.: 
American Psychological Association, 1968). 

27. Hilton M. Bialek and Michael McNeil, Pre- 
liminary Study of Motivation and Incentives in 
Basic Combat Training, Technical Report, no. G 
(Presidio of Monterey, Calif.: Human Resources 
Research Office, Division No. 3, 1968). 



BIBLIOGRAPHY 



Ammermaii, Harry L., and Melching, William H. 
The Derivation, Analysis, and Classification, 
of Instructional Objectives. Technical Re- 
port, no. 4. Ft. Bliss, Texas: Human Re- 
sources Research Oface, 1966- 

Baker, Robert A.; Mathers, Boyd L.; and Roach, 
Eugene G. The Effects of Increasing and 
Decreasing Training Time on Proficiency 
in the Critical Armor Skills. Technical 
Report, no. 55. Alexandria, Va.; Human 
Resources Research Office, 1959. 

Berman, Mark L. “Improving the Performance 
of Culturally Disadvantaged Adult Students." 
Educational Technology 8 (1968). 

Bialek, Hilton M., and McNeil, Michael. Prelim- 
inary Study of Motivation and Incentives 
in Basic Combat Training. Technical Re- 
port, no. 6. Presfdio of Monteiey, Calif.: 
Human Resources Research Office, Divi- 
sion No. 3, 1968 



Bloom, Benjamin S. "Learning for Mastery.” 
UCLA Evaluation Comment 1 (1968). 

3 




Briggs, Leslie J. Instructional Media. Pittsburgh, 
Pa.: American Institutes for Research, 1967. 

Sequencing of Instruction in Relation to 

Hierarchies of Competence. Pittsburgh, Pa.: 
American Institutes for Research, 1968. 

Brown, George H.; Zaynor, Wesley C.; Bernstein, 
Alvin J.; and Shoemaker, Harry A. Devel- 
opment and Evaluation of an Improved 
Field Repair Coarse. Technical Report, 
no. 58. Alexandria, Va.; Human Resources 
Research Office, 1959. 

Cassileth, Barrie. Review of Concepts and Lit- 
erature on Contingency Management. Pro- 
fessional Paper, no. 15. Ft. Knox, Ky.: 
Human Resources Research Office, 1968. 

“Characteristics and Performances of ‘New 
Standards 1 Men.” In Project One Hundred 
Thousand. Washington, D.C.: Office of 
Secretary of Defense, Assistant Secretary 
for Manpower and Reserve Affairs, 1968. 



89 



Cohen, Howard M. ‘‘Educational Therapy: The 
Design of Learning Environments.: In Re- 
search for Psychotherapy, vol. 3, edited 
by John L. Shlien. Washington, D.C.: Amer- 
ican Psychological Association, 1968. 

Crawford Meredith P. “Concepts of Training 
In Psychological Principles in System 
Development , edited by Robert M. Gagne. 
New York: Holt, Rinehart, and Winston, 
1962. 

Cronbach, Lee J. “How Can Instruction Be 
Adopted to Individual Differences?” In 
Learning and Individual Differences , edited 
by Robert M. Gagne. Columbus, Ohio: 
Charles E. Merrill, 1967. 

de Neufville, Richard, and Conner, Caryl. “How 
Good Are Our Schools?'* American Education 
9 (1966). 

Ediing, Jack V.; “The Contribution of Behavioral 
Science to Instructional Technology.” Teach- 
ing Research. Monmouth, Oreg.: State Sys- 
tem of Higher Education, 1968. 

Fox, Wayne L.; Taylor, John E.; and Caylor, 
John S. Aptitude Level and the Acquisition 
of Skills and Knowledges in a Variety of 
Military Training Tasks. Technical Report, 
no. 6. Presidio of Monterey, Calif.: Human 
Resources Research Office, Division No. 3, 
1969. 

Gagne, Robert M. The Conditions of Learning. 
New York: Holt, Rinehart, ana iVinston, 1965. 

Goffard, S. James; Showel, Morris; and Bialek, 
Hilton M. A Study of Category IV Personnel 
in Basic Training. Technical Report, no. 2. 
Presidio of Monterey, Calif.: Human Re- 
sources Research Office, Division No. 3, 
1966. 

Grimsley, Douglas L. Acquisition, Retention, 
and Retraining: Training Category IV Per- 
sonnel with Low Fidelity Devices. Tech- 
nical Report, no. 12. Presidio of Monterey, 
Calif.: Human Resources Research Office, 
Division No. 3, 1909. 



Hedlund, James L., “Miscellaneous Notes Re- 
garding Army Classification Scores and 
General Intelligence.” Unpublished paper. 
U.S. Medical Service Corps. 

“Institutionalization of Expectancy: A Special 
Issue.” Urban Review 3 (1968). 

Mager, Robert F. Preparing Objectives for Pro- 
grammed Instruction. San Francisco: Fearon, 
1962. 

Montague, Ernest K., and Showel, Morris. A Re- 
view of Combat Support Training. Technical 
Report, no. 19. Presidio of Monterey, Calif.: 
Human Resources Research Organization, 
Division No. 3, 1969. 

“Project One Hundred Thousand.” Commanders’ 
Digest , December, 1968. 

Shoemaker, Harry A. “lhe Functional Context 
Method of Instruction.” IRE Transactions 
on Education E-3 (1960). 

Smith, Robert G., Jr. The Development of Train- 
ing Objectives, Research Bulletin, no. 11. 
Alexandria, Va.: Human Resources Re- 
search Office, 1964. 

Sticht, Thomas G. “Some Relationships of Mental 
Aptitude, Reading Ability, and Listening 
Ability Using Normal and Time-Compressed 
Speech.” Journal cf Communication 18 
(1968): 243-258. 

“Training.” U.S. Continental Army Command 
CONARC Regulation 350-1001. Fort Mon- 
roe: Headquarters United States Continental 
Army Command, 1968. 

Ward, Joseph S.; Fooks, Nelson I,; Kern, Richard 
P.; and McDonald, Robert D. Development 
and Test of an Integrated Basic Combat / 
Advanced Individual Training Progrcm for 
Medical Corptmen (MOS 91 A 10). Technical 
Report. Presidio of Monterey, Calif: Divi- 
sion No. 3, 1968, in press. 




98 

t 



90 



Testing Adults 



TESTING DISADVANTAGED ADULTS 



Robert C. Droege 



This presentation will be based on United 
States Employment Service (USES) research to 
develop tests for use in counseling disadvan- 
taged adults, especially that research that 
should have the greatest relevance to adult 
basic education programs. The approach of 
this paper will be as follows: (1) a little back- 
ground about the USES research program and 
the new direction it is taking; (2) a summary of 
developments that have implications for test- 
ing educationally deficient adults; (3) more de- 
tailed information on research on specific 
tests and techniques; and (4} an invitation to 
research. 

BACKGROUND 

The U.S. Employment Service has had more 
than thirty years of experience in developing 
tests foi* use in personnel selection and voca- 
tional counseling. This experience has been 
based primarily on research with adults who 
have at least sixth grade literacy skills. The 
research program is a federal-state partner- 
ship in which the USES national office deter- 
mines priorities and coordinates the work of 
state employment service test research per- 
sonnel. The operational tools and techniques 
resulting from the research are made avail- 
able to the 2,090 local employment service 
offices and also to schools and other organiza- 
tions through release agreements. 

The major product of the USES test de- 
velopment program prior to 1963 was the Gen- 
eral Aptitude Test Battery {GATB), used in con- 
nection with employment selection and vocational 
counseling. The GATB consists of twelve tests 
measuring nine basic vocational aptitudes. It 
can be administered in about two and one-half 
hours and indicates an individual’s potentialit- 
ies in a wide variety of specific occupations 
and in families of occupations with similar 
aptitude requirements. A continuing program of 
occ ipational validation of the GATB is con- 
ducted by the employment service to extend its 
Q ;e to additional occupations. 
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During the last five years a major effort 
has been made to develop new and improved 
instruments to meet the needs of new man- 
power programs concerned with disadvantaged 
individuals. A nonreading alternate form of 
the GATB w&s developed. A screening proce- 
dure was devised to Help ensure that GATB 
tests were appropriate for individuals to whom 
they were to be administered. A booklet, “Doing 
Your Best on Aptitude Tests,” was prepared, 
and a set of pretesting orientation exercises 
was developed to be used with individuals with 
limited test-taking experience. 

Basic occupational literacy tests of read- 
ing and arithmetic skills are being developed. 
They will assist in making appropriate refer- 
rals to literacy training programs and in de- 
termining the type and amount of training in 
these basic skills w’hich an individual needs in 
order to meet the requirements of specific 
occupations and occupational training. For em- 
ployment service applicants who are so severe- 
ly i Ivantaged that conventional testing is 
i ible, work-sample techniques are being 

tr, ,ut which give inexperienced individuals 
the feel of activities associated with various 
kinds of work. 

Research is continuing on the GATB. The 
number of specific occupations for which the 
GATB has been validated has risen to more 
than 400, including many newly emergent occu- 
pations. Special research studies are in pro- 
gress to determine the effectiveness of the 
GAYB and other USES tests in training situa- 
tions such as the Manpower Training and De- 
velopment Act (MDTA) programs. 

The GATB is widely used by schools, gov- 
ernment agencies, and nonprofit counseling 
agencies. Other organizations are also coop- 
erating in a variety of research projects in- 
volving existing and new USES tests, such as 
the development of model processes and pro- 
cedures for testing, a feasibility study of a 
programmed interpretation of GATB scores, 
research on the USES nonreading aptitude 
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tests, a study of the usefulness of the GATB 
predicting success in vocational training, and 
an evaluation of a pilot computer-assisted 
vocational guidance program. 

A SUMMARY OF DEVELOPMENTS 

Nonreading Aptitude Tests 

The USES General Aptitude Test Battery 
has been a valuable tool in the measurement 
of aptitudes of job applicants and candidates 
for occupational training. However, many of 
the hard core unemployed who need vocational 
counseling and remedial services to help them 
become employable do not have sufficient lit- 
eracy skills to take all of the GATB tests. 

This problem led the U.S. Employment 
Service to work toward development of a non- 
reading edition of the GATB for use with the 
educationally deficient. The GATB was used as 
the model in this development for two reasons: 

1. The GATB measures the important voca- 
tionally significant aptitudes. This has 
been demonstrated through factor anal- 
yses, correlations with other tests, and 
occupational validation studies. 1 

2. The GATB has been validated extensive- 
ly against occupational criteria. The occu- 
pational norms developed in these studies 
provide a ready-made basis for interpret- 
ing scores on a nonreading edition of the 
GATB. 

The research of the nonreading GATB was 
initiated in 1963 and has progressed through 
the stages of test construction, item analyses, 
preliminary tryout, validation, and standard- 
ization studies. The research is described in 
a USES technical report available from the 
U.S. Department of Labor. 2 The nonreading 
edition of the GATB resulting from this re- 
search is being released for operational use 
this spring. The new battery of aptitude tests 
for use with the disadvantaged consists of eight 
new tests and six of the GATB tests. Total 
administration time is about three and one-half 
hours, about an hour longer than the GAiB. 
Although the major use of the new battery is 
anticipated to be in the employment service, 
other organizations concerned with counseling 
disadvantaged adults will find the tests useful. 

This research is only a first step in a 
continuing effort to develop and refine aptitude 
measurement of the disadvantaged. Just as the 
GATB becomes more valuable as additional 
validation data are collected, the usefulness of 



the nonreading aptitude tests will increase as 
additional research is done on them. At this 
point in the research, an aptitude test battery 
has been developed that (1) is oriented to the 
capabilities of the educationally disadvantaged 
and (2) provides measures underlying the occu- 
pationally-oriented GATB. However, much 
more needs to be done to refine these meas- 
ures and to validate them against training and 
job success of disadvantaged individuals. Ul- 
timately, the occupational norms structure for 
the nonreading aptitude tests will be based on 
occupational validation for disadvantaged 
groups. 

Pretesting Orientation Techniques 

One thing that the USES research on dis- 
advantaged individuals has shown clearly is 
the critical importance of pretesting orienta- 
tion. In 1966 state employment services were 
asked to observe the behavior of disadvantaged 
persons taking the experimental nonreading 
aptitude tests. Typical observations were (1) 
many did not report for testing; (2) examinees 
often became confused but hesitated to ask 
questions; (3) many marked answers randomly; 
and (4) some deliberately skipped pages to fin- 
ish quickly. There was a consensus that the 
disadvantaged were anxious, easily embarras- 
sed, easily discouraged, sensitive to possible 
reactions of others to their behavior, and 
easily distracted. Three major areas of pre- 
testing orientation needed were identified: 

1. An introduction to the purpose of testing . 
Orientation is needed to show the exam- 
inee how testing will be of use to him ir 
job or training placement. An understand- 
ing of the purpose of testing should help 
motivate examinees to do their best on 
the test. 

2. Practice test taking . The manipulation ot 
test materials, working problems simi- 
lar to those in the test, and practice in 
pacing work to time limits should build 
confidence in ability to take the test. 

3. Suggestions on how to take tests. Middle 
class persons have built up a store of in- 
formation about tests and test-taking tech 
niques (test wiseness) which allows them 
to use their time efficiently, avoid errors, 
and detect cues to right answers. Disad- 
vantaged persons have had little positive 
experience with tests. Development of 
their test wiseness would put them on a 
more competitive footing with others. 



Several state employment services are 
working on development of pretesting orienta- 
tion materials in these three areas. Various 
types of audio and visual materials and prac- 
tice tests are being developed. The objective 
is a comprehensive and flexible package of 
pretesting orientation devices. So far, two 
USES pretesting orientation techniques have 
been developed. One is a booklet on ‘‘Doing 
Your Best on Aptitude Tests” and it is on pub- 
lic sale at the Government Printing Office. A 
second technique, “USES Pretesting Orienta- 
tion Exercises,” provides practice on tests 
like those in the GATB. 

Work Sample Techniques 

Among the disadvantaged are those who 
have great difficulty relating to any formal 
test situation. For these, work-sample assess- 
ment techniques may be useful. Work samples 
are standardized job performance tasks de- 
signed for use in developing the employability 
of disadvantaged individuals. The work-sample 
technique consists of the work samples per se, 
a structured environment in which they are 
performed, and evaluations of the client’s be- 
havior based on observations. The work samp- 
les take about two weeks io administer. They 
provide the individual and his vocational coun- 
selor with a common basis for discussion, 
provide a basis for evaluation of the individ- 
ual’s occupational potentials, and provide the 
individual with a basis for developing insights 
into areas of interests, aptitudes, and moti- 
vation. Although the work-sample technique is 
appropriate for any applicant as a simulated 
job try-out experience, it ie particularly useful 
with disadvantaged clients having histories of 
failure in school. 

The tasks selected as work samples are 
simulations of activities that would be encoun- 
tered on a regular job. Standard tools and equip- 
ment such as screwdrivers, saws, adding ma- 
chines, typewriters, needles and thread, solder- 
ing guns, pipe couplers, blouse patterns, and 
many other workaday items are used. "The 
work-sampling environment is a typical factory 
setting with work benches or a business office 
and its equipment. The work samples range 
in complexity from very simple, structured 
operations to difficult activities involving sym- 
bolic reasoning and abstract conceptualization. 
They are derived from activities performed in 
competitive industry and are representative of 
a wide variety of interrelated functions such as 
psychomotor coordination, and spatial rela- 
O *■ Because they are not different from the 



kind of work a potential employee would be re- 
quired to perform in an ordinary job, the ex- 
perience is less threatening and more meaning- 
ful to a disadvantaged and handicapped popula- 
tion. In addition, the administration of such 
work samples in an industrial setting maxi- 
mizes the usefulness of the observations. 

The use of the work-sample technique 
for the disadvantaged was investigated by an 
experimental and demonstration project in- 
volving 268 jobless persons. It was funded by 
the Department of Labor in a slum area in 
north Philadelphia. The Philadelphia Jewish 
Employment and Vocational Service (JEVS) con- 
ducted the experiment with a grant which in- 
cluded funds for allowances to the people who 
took part. A cooperating agency was the North 
Philadelphia Human Resources Development 
(HRD) Center of Pennsylvania State Employ- 
ment Service. 

Of the 268 taking part in the experiment, 
107 were referred by their counselors to jobs, 
57 to rehabilitation services, and 43 were 
placed in job training programs. No immediate 
results could be obtained for the remaining 61 
or 23 percent, as the HRD counselors felt that 
further evaluation was required. Applicants 
were observed and evaluated on work attitudes, 
accuracy of performance, promptness in re- 
porting to work, learning speed, acceptance 
of authority, and other w r ork-related behaviors. 
The technique had a high degree of acceptance 
among the participants. That acceptance en- 
abled vocational counselors to understand and 
communicate with their clients. 

Based on the comparative experience of 
an experimental and control group, the w T ork- 
sample technique seems (1) to make easier the 
development of vocational objectives suited to 
the applicant’s abilities and potentials; (2) to 
boost the applicant’s chances to be referred to 
a wide range of job openings, to get a job on 
the first referral, and to hold and to adjust to 
a job or training position; (3) to help the coun- 
selor to identify more readily the need for giv- 
ing the applicant supportive services; (4) to 
enable counselors to estimate for employers 
the potential for learning and the likely stabi- 
lity of individuals who have been out of w'ork a 
long time or have no work experience whatso- 
ever; and (5) to give the disadvantaged person 
more confidence by helping him understand his 
ability to work and to learn. 

Based on these preliminary findings, the 
U.S. Employment Service is now preparirg to 
evaluate the technique as an employment ser- 
vice operation in about ten cities. This eval- 



uation will consist of comparing two groups of 
applicants — one group of people who do the 
work samples and a matched control group of 
people who do not do them. The purpose of the 
study is to determine if the use of work sam- 
ples in addition to the traditional counseling 
techniques improved employability. 

Testing for Achievement of 
Basic Literacy Skills 

The topic of testing for achievement of basic 
literacy skills will make up the largest portion 
of this paper since this topic has direct rele- 
vance to adult basic education programs. First, 
the nature of achievement tests of basic skills, 
and their typical orientation to school-age 
youth will be considered. Second, the charac- 
teristics of adults enrolled in basic education 
courses and implications for testing their 
skills will be discussed. Third, the inadequa- 
cies of presently available tests for use with 
adults will be discussed. Fourth, what the em- 
ployment service is doing to develop a suitable 
test for adults will be outlined. 

Nature of Achievement Tests 

Achievement tests measure an individual's 
present level of performance in reading, arith- 
metic, or other types of skills. Of the many 
types of achievement which may be tested, 
reading and arithmetic skills are perhaps the 
most important. These may be called “basic 
skills 1 ' because they are essentia! to a wide 
variety of activities, including the learning and 
subsequent performance of most jobs. These 
skills are primarily learned in school and pro- 
bably are the chief outcomes of the regular 
school curriculum. Achievement tests provide 
objective, standardized measures of an indivi- 
dual's present performance in the basic liter- 
acy skills. 

Achievement tests have what is defined by 
the Standards for Educational and Psychologi- 
cal Tests and Manuals as content validity. 3 The 
Standards state, “Content validity is demon- 
strated by showing how well the content of the 
test samples the class situation or subject mat- 
ter about which conclusions are to be drawn. 1 ’ 4 
In other words, provided that the tests have 
adequate reliability, the usefulness of achieve- 
ment tests rests primarily on the appropriate- 
ness of their content rather than on their rela- 
tionship to any external criterion. The areas to 
be covered by an achievement test intended for 
use in the schools, and the relative emphasis 
to be given to the various topics within each 
area, are usually determined by reviewing cur- 



ricula or by the expert judgment of subject- 
matter specialists. 

Anastasi observes that achievement tests 
are an important factor in remedial education 
programs, both in identifying those individuals 
who have specific types of deficiencies and in 
measuring progress in the remedial training 
provided. 5 She also points out that the use of 
achievement tests in remedial education pro- 
motes learning by revealing weaknesses in 
past learning, giving directions to subsequent 
learning, and motivating the learner. Achieve- 
ment test results also provide the basis for 
adapting instruction to meet individual needs 
by ascertaining what each individual knows or 
can do, or does not know or cannot do. The 
types of skills measured by reading and arith- 
metic achievement tests are not assumed to 
remain at a constant level throughout life. They 
ordinarily are developed slowly throughout 
years of education through regular use in plan- 
ned or unplanned school experiences supple- 
mented by the effects of outside activities. For 
adults who are not longer in school, the skills 
may continue to develop by being used on jobs 
or in other activities, or they may deteriorate 
if the individual does not have the opportunity 
to exercise them. Just as the skills usually are 
developed initially through regular schooling, 
they may also be improved through literacy 
training provided under programs such as 
VfDTA or adult education. Results on educa- 
tional achievement tests are usually expressed 
in grade equivalents (or grade scores), al- 
though other types of scales may also be used. 
Publishers of the major achievement test ser- 
ies usually try to obtain a large and represen- 
tative sample of school children on which to 
base their grade-equivalent norms; for exam- 
ple, more than 850,000 pupils in grades one 
through nine in 264 schools in all fifty states 
were tested to derive the norms for the Stan- 
ford Achievement Test. 6 There are some 
technical problems with the notion of grade 
equivalents even when used with school child- 
ren for whom they are intended. 

1. Grade equivalents assume regular growth 
throughout the school years. 

2. Grade equivalents which are extremely 
high or low relative to grade placement 
usually must be extrapolated rather than 
based on data. 

3. The interpretation of extrapolated values 
is difficult because a raw score in the 
extrapolated range does not necessarily 
represent the median score which would 



actually be obtained by pupils at the cor- 
responding grade level. 

Despite such limitations, however, the 
grade-equivalent concept works satisfactorily 
with school children because the referrent 
group — pupils in the same grade — is mean- 
ingful to the teachers who are the primary 
users. 

The grade equivalent concept is usually 
carried over when the tests are u^ed with 
adults, because the results are used primarily 
by educators who think in the same terms and 
often use some of the same curriculum mater- 
ials for adults as for children. However, in our 
opinion, it becomes an even more misleading 
index of achievement for adults that it is for 
children. It makes little sense to say that an 
adult has a reading level of 7.5 grades, for he 
is a low-achieving adult with an adult's acti- 
vities, interest, and needs and not a child in 
the seventh grade. He is not enrolled in a 
standard school curriculum, and a comparison 
with norms based on school children is of 
little value in planning future training or other 
remedial action. 

Characteristics of Adults Enrolled 
in Basic Education Courses 

The individuals with whom reading and 
arithmetic tests are used in the employment 
service represent a group quite similar to 
those enrolled in adult basic education pro- 
grams. Several important differences from the 
general population affect the administration 
and interpretation of tests. 

First, the disadvantaged population tends 
to be educationally deficient. School dropout is 
one of the chief indicators of disadvantage, and 
there is a strong likelihood that those who drop 
out of school will have lower levels of achieve- 
ment than those who remain in school to grad- 
uate. There is also evidence that individuals 
who have dropped out of school generally have 
levels of tested achievement well below their 
stated years of education. A study conducted 
by the employment service found that a sample 
of 578 persons with an average of 9.4 years of 
education had average tested achievement of 
C.O grades, an average discrepancy of almost 
three and one half years. It should be noted 
that the relationship between achievement 
level and years of education is low, indicating 
that the number of years of education is not a 
dependable index of level of achievement for 
disadvantaged adults, although used as the in- 
dex to determine functional illiteracy by the 
U.S. Bureau of the Census. 
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Second, many disadvantaged adults have 
an unfavorable opinion of tests because they 
did poorly on them when in school or because 
testa have beer used to reject them for jobs. 
Therefore, they may resent being tested and 
be unwilling to devote the effort to do their 
be3t, particularly if the purpose of the test and 
its benefit to them have not been clearly ex- 
plained. 

Third, many have much more limited 
prior test-taking experience than advantaged 
persons and are not prepared to do their best 
on tests. They do not follow directions cor- 
rectly, do not work quickly, and do not guess 
when it would be to their advantage to do so. 

People with these characteristics are 
sufficiently different from the general popu- 
lation to require special treatment in testing. 
It is important that the testing environment be 
structured to protect the individual’s dignity 
and self-esteem. Special attention needs to be 
given to ensure that the test is perceived by 
the examinee as being worthwhile and valuable 
to him, that the test content is appropriate and 
meaningful, and that directions are adequate 
and understood by the examinee. 

The extent of educational deficiency ex- 
isting in the United States is much greater than 
usually supposed. Although the median educa- 
tional level of the adult population is approach- 
ing twelve years, there are more than eight 
million persons twenty-five years of age and 
older who have completed five years or less of 
education, and twenty-three million who have 
eight years or less. These low-education in- 
dividuals are concentrated mainly in the fol- 
lowing groups: (1) older persons; (2) persons 
living on farms, especially Negroes; (3) per- 
rons with rural backgrounds who have moved 
to urban centers, including Puerto Rican mi- 
grants; and (4) migrant farm workers and other 
disadvantaged groups, including Spanish- 
speaking persons in the western and south- 
western United States. Although low education 
is more prevalent among these groups, it is 
not confined to them. There are substantial 
proportions of low-education individuals in ail 
states. Associated with low education is, of 
course, low levels of achievement in the skills 
and knowledge which are learned in school. 
There are, therefore, millions of persons 
whose achievement is too low to qualify them 
’ r any jobs except those menial types of work 
in which literacy skills are not important. As 
noted above, an additional group who claim 
more than eight years of education also evi- 
dence an educational deficiency which inter- 
feres with their employability. 
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